Login
[x]
Log in using an account from:
Fedora Account System
Red Hat Associate
Red Hat Customer
Or login using a Red Hat Bugzilla account
Forgot Password
Login:
Hide Forgot
Create an Account
Red Hat Bugzilla – Attachment 934589 Details for
Bug 1138419
VMs pool disappeared after creating a Sub Template version
[?]
New
Simple Search
Advanced Search
My Links
Browse
Requests
Reports
Current State
Search
Tabular reports
Graphical reports
Duplicates
Other Reports
User Changes
Plotly Reports
Bug Status
Bug Severity
Non-Defaults
|
Product Dashboard
Help
Page Help!
Bug Writing Guidelines
What's new
Browser Support Policy
5.0.4.rh83 Release notes
FAQ
Guides index
User guide
Web Services
Contact
Legal
This site requires JavaScript to be enabled to function correctly, please enable it.
VDSM log
vdsm.log (text/plain), 763.36 KB, created by
meital avital
on 2014-09-04 18:29:04 UTC
(
hide
)
Description:
VDSM log
Filename:
MIME Type:
Creator:
meital avital
Created:
2014-09-04 18:29:04 UTC
Size:
763.36 KB
patch
obsolete
>Thread-43::DEBUG::2014-09-04 21:01:01,181::BindingXMLRPC::318::vds::(wrapper) client [10.35.163.104] >Thread-43::DEBUG::2014-09-04 21:01:01,182::task::595::Storage.TaskManager.Task::(_updateState) Task=`b679da70-d357-43df-a851-249061571448`::moving from state init -> state preparing >Thread-43::INFO::2014-09-04 21:01:01,183::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='78390355-2a2d-41e5-aea5-fb426559f747', options=None) >Thread-43::DEBUG::2014-09-04 21:01:01,184::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.78390355-2a2d-41e5-aea5-fb426559f747`ReqID=`78ad72c7-929e-4ae8-8552-3b2e7f2835ad`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-43::DEBUG::2014-09-04 21:01:01,184::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.78390355-2a2d-41e5-aea5-fb426559f747' for lock type 'shared' >Thread-43::DEBUG::2014-09-04 21:01:01,184::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.78390355-2a2d-41e5-aea5-fb426559f747' is free. Now locking as 'shared' (1 active user) >Thread-43::DEBUG::2014-09-04 21:01:01,185::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.78390355-2a2d-41e5-aea5-fb426559f747`ReqID=`78ad72c7-929e-4ae8-8552-3b2e7f2835ad`::Granted request >Thread-43::DEBUG::2014-09-04 21:01:01,185::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`b679da70-d357-43df-a851-249061571448`::_resourcesAcquired: Storage.78390355-2a2d-41e5-aea5-fb426559f747 (shared) >Thread-43::DEBUG::2014-09-04 21:01:01,185::task::993::Storage.TaskManager.Task::(_decref) Task=`b679da70-d357-43df-a851-249061571448`::ref 1 aborting False >Thread-43::INFO::2014-09-04 21:01:01,207::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': u'/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_qa_shared__iso__domain/7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 8L, 'domains': '180c43ee-5baf-41b7-87c7-c0214b51fe8f:Active,7ad04229-b793-4f73-ad10-5e41a4e836ff:Active,7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6:Active', 'master_uuid': u'180c43ee-5baf-41b7-87c7-c0214b51fe8f', 'version': '3', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'180c43ee-5baf-41b7-87c7-c0214b51fe8f': {'status': 'Active', 'diskfree': '1820606857216', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246104576', 'version': 3}, '7ad04229-b793-4f73-ad10-5e41a4e836ff': {'status': 'Active', 'diskfree': '1820606857216', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246104576', 'version': 0}, '7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6': {'status': 'Active', 'diskfree': '18881708032', 'isoprefix': u'/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_qa_shared__iso__domain/7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '652610633728', 'version': 0}}} >Thread-43::DEBUG::2014-09-04 21:01:01,207::task::1191::Storage.TaskManager.Task::(prepare) Task=`b679da70-d357-43df-a851-249061571448`::finished: {'info': {'name': 'No Description', 'isoprefix': u'/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_qa_shared__iso__domain/7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 8L, 'domains': '180c43ee-5baf-41b7-87c7-c0214b51fe8f:Active,7ad04229-b793-4f73-ad10-5e41a4e836ff:Active,7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6:Active', 'master_uuid': u'180c43ee-5baf-41b7-87c7-c0214b51fe8f', 'version': '3', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'180c43ee-5baf-41b7-87c7-c0214b51fe8f': {'status': 'Active', 'diskfree': '1820606857216', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246104576', 'version': 3}, '7ad04229-b793-4f73-ad10-5e41a4e836ff': {'status': 'Active', 'diskfree': '1820606857216', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246104576', 'version': 0}, '7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6': {'status': 'Active', 'diskfree': '18881708032', 'isoprefix': u'/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_qa_shared__iso__domain/7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '652610633728', 'version': 0}}} >Thread-43::DEBUG::2014-09-04 21:01:01,208::task::595::Storage.TaskManager.Task::(_updateState) Task=`b679da70-d357-43df-a851-249061571448`::moving from state preparing -> state finished >Thread-43::DEBUG::2014-09-04 21:01:01,208::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.78390355-2a2d-41e5-aea5-fb426559f747': < ResourceRef 'Storage.78390355-2a2d-41e5-aea5-fb426559f747', isValid: 'True' obj: 'None'>} >Thread-43::DEBUG::2014-09-04 21:01:01,208::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-43::DEBUG::2014-09-04 21:01:01,208::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.78390355-2a2d-41e5-aea5-fb426559f747' >Thread-43::DEBUG::2014-09-04 21:01:01,208::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.78390355-2a2d-41e5-aea5-fb426559f747' (0 active users) >Thread-43::DEBUG::2014-09-04 21:01:01,208::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.78390355-2a2d-41e5-aea5-fb426559f747' is free, finding out if anyone is waiting for it. >Thread-43::DEBUG::2014-09-04 21:01:01,209::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.78390355-2a2d-41e5-aea5-fb426559f747', Clearing records. >Thread-43::DEBUG::2014-09-04 21:01:01,209::task::993::Storage.TaskManager.Task::(_decref) Task=`b679da70-d357-43df-a851-249061571448`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-09-04 21:01:01,294::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-09-04 21:01:01,294::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 57. >Dummy-41::DEBUG::2014-09-04 21:01:01,544::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/78390355-2a2d-41e5-aea5-fb426559f747/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >GuestMonitor-quota__vm::DEBUG::2014-09-04 21:01:01,885::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >GuestMonitor-numa__test::DEBUG::2014-09-04 21:01:01,887::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >GuestMonitor-quota__vm::DEBUG::2014-09-04 21:01:01,904::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >GuestMonitor-numa__test::DEBUG::2014-09-04 21:01:01,905::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >GuestMonitor-quota__vm::DEBUG::2014-09-04 21:01:01,917::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >GuestMonitor-numa__test::DEBUG::2014-09-04 21:01:01,918::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >Dummy-41::DEBUG::2014-09-04 21:01:01,965::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.051418 s, 19.9 MB/s\n'; <rc> = 0 >Dummy-41::DEBUG::2014-09-04 21:01:03,977::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/78390355-2a2d-41e5-aea5-fb426559f747/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-41::DEBUG::2014-09-04 21:01:04,338::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0124471 s, 82.3 MB/s\n'; <rc> = 0 >Thread-14054::DEBUG::2014-09-04 21:01:04,915::task::595::Storage.TaskManager.Task::(_updateState) Task=`9100d19b-acc4-4d6a-bca3-2c8dce981cd2`::moving from state init -> state preparing >Thread-14054::INFO::2014-09-04 21:01:04,915::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14054::INFO::2014-09-04 21:01:04,915::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180c43ee-5baf-41b7-87c7-c0214b51fe8f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000521396', 'lastCheck': '5.5', 'valid': True}, '7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000895173', 'lastCheck': '5.6', 'valid': True}, '7ad04229-b793-4f73-ad10-5e41a4e836ff': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000439432', 'lastCheck': '3.8', 'valid': True}} >Thread-14054::DEBUG::2014-09-04 21:01:04,915::task::1191::Storage.TaskManager.Task::(prepare) Task=`9100d19b-acc4-4d6a-bca3-2c8dce981cd2`::finished: {'180c43ee-5baf-41b7-87c7-c0214b51fe8f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000521396', 'lastCheck': '5.5', 'valid': True}, '7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000895173', 'lastCheck': '5.6', 'valid': True}, '7ad04229-b793-4f73-ad10-5e41a4e836ff': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000439432', 'lastCheck': '3.8', 'valid': True}} >Thread-14054::DEBUG::2014-09-04 21:01:04,916::task::595::Storage.TaskManager.Task::(_updateState) Task=`9100d19b-acc4-4d6a-bca3-2c8dce981cd2`::moving from state preparing -> state finished >Thread-14054::DEBUG::2014-09-04 21:01:04,916::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14054::DEBUG::2014-09-04 21:01:04,916::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14054::DEBUG::2014-09-04 21:01:04,916::task::993::Storage.TaskManager.Task::(_decref) Task=`9100d19b-acc4-4d6a-bca3-2c8dce981cd2`::ref 0 aborting False >Thread-14054::DEBUG::2014-09-04 21:01:04,936::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >Thread-14054::DEBUG::2014-09-04 21:01:04,937::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >Dummy-41::DEBUG::2014-09-04 21:01:06,350::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/78390355-2a2d-41e5-aea5-fb426559f747/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-41::DEBUG::2014-09-04 21:01:06,712::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.015061 s, 68.0 MB/s\n'; <rc> = 0 >GuestMonitor-numa__test::DEBUG::2014-09-04 21:01:06,927::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >GuestMonitor-numa__test::DEBUG::2014-09-04 21:01:06,928::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >GuestMonitor-numa__test::DEBUG::2014-09-04 21:01:06,928::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >GuestMonitor-quota__vm::DEBUG::2014-09-04 21:01:06,931::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >GuestMonitor-quota__vm::DEBUG::2014-09-04 21:01:06,932::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >GuestMonitor-quota__vm::DEBUG::2014-09-04 21:01:06,933::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >Dummy-41::DEBUG::2014-09-04 21:01:08,723::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/78390355-2a2d-41e5-aea5-fb426559f747/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-41::DEBUG::2014-09-04 21:01:09,087::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.012527 s, 81.7 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-04 21:01:09,332::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-14::DEBUG::2014-09-04 21:01:09,332::__init__::225::IOProcess::(_processLogs) Message size is 190 >Thread-14::DEBUG::2014-09-04 21:01:09,332::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:01:09,332::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-14::DEBUG::2014-09-04 21:01:09,332::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:01:09,332::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:01:09,333::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:01:09,333::__init__::225::IOProcess::(_processLogs) (843993) Finding callback 'statvfs'... >Thread-14::DEBUG::2014-09-04 21:01:09,333::__init__::225::IOProcess::(_processLogs) (843993) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-04 21:01:09,333::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(843993) Building response >Thread-14::DEBUG::2014-09-04 21:01:09,333::__init__::225::IOProcess::(_processLogs) (843993) Queuing response >Thread-14::DEBUG::2014-09-04 21:01:09,333::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:01:09,333::__init__::225::IOProcess::(_processLogs) Sending response sized 329 >Thread-18::DEBUG::2014-09-04 21:01:09,334::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_qa_shared__iso__domain/7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-14::DEBUG::2014-09-04 21:01:09,677::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-09-04 21:01:09,679::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1618 bytes (1.6 kB) copied, 0.00113913 s, 1.4 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-04 21:01:09,682::__init__::225::IOProcess::(_processLogs) Message size is 166 >Thread-14::DEBUG::2014-09-04 21:01:09,685::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:01:09,686::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-04 21:01:09,687::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:01:09,689::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:01:09,690::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:01:09,691::__init__::225::IOProcess::(_processLogs) (843994) Finding callback 'statvfs'... >Thread-14::DEBUG::2014-09-04 21:01:09,692::__init__::225::IOProcess::(_processLogs) (843994) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-04 21:01:09,693::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(843994) Building response >Thread-14::DEBUG::2014-09-04 21:01:09,694::__init__::225::IOProcess::(_processLogs) (843994) Queuing response >Thread-14::DEBUG::2014-09-04 21:01:09,696::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:01:09,697::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-14::DEBUG::2014-09-04 21:01:09,703::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-17::DEBUG::2014-09-04 21:01:09,705::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_artyom__storage__rhevm__35/180c43ee-5baf-41b7-87c7-c0214b51fe8f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-14::DEBUG::2014-09-04 21:01:09,705::__init__::225::IOProcess::(_processLogs) Message size is 190 >Thread-14::DEBUG::2014-09-04 21:01:10,036::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-17::DEBUG::2014-09-04 21:01:10,040::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n474 bytes (474 B) copied, 0.000339092 s, 1.4 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-04 21:01:10,040::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-04 21:01:10,044::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:01:10,045::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:01:10,047::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:01:10,048::__init__::225::IOProcess::(_processLogs) (843995) Finding callback 'statvfs'... >Thread-14::DEBUG::2014-09-04 21:01:10,049::__init__::225::IOProcess::(_processLogs) (843995) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-04 21:01:10,050::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(843995) Building response >Thread-14::DEBUG::2014-09-04 21:01:10,051::__init__::225::IOProcess::(_processLogs) (843995) Queuing response >Thread-14::DEBUG::2014-09-04 21:01:10,052::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:01:10,054::__init__::225::IOProcess::(_processLogs) Sending response sized 329 >Thread-14::DEBUG::2014-09-04 21:01:10,060::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-14::DEBUG::2014-09-04 21:01:10,063::__init__::225::IOProcess::(_processLogs) Message size is 166 >Thread-14::DEBUG::2014-09-04 21:01:10,064::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:01:10,065::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-04 21:01:10,067::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:01:10,068::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:01:10,069::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:01:10,070::__init__::225::IOProcess::(_processLogs) (843996) Finding callback 'statvfs'... >Thread-14::DEBUG::2014-09-04 21:01:10,071::__init__::225::IOProcess::(_processLogs) (843996) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-04 21:01:10,073::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(843996) Building response >Thread-14::DEBUG::2014-09-04 21:01:10,074::__init__::225::IOProcess::(_processLogs) (843996) Queuing response >Thread-14::DEBUG::2014-09-04 21:01:10,075::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:01:10,076::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-14::DEBUG::2014-09-04 21:01:10,083::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-14::DEBUG::2014-09-04 21:01:10,085::__init__::225::IOProcess::(_processLogs) Message size is 183 >Thread-14::DEBUG::2014-09-04 21:01:10,086::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:01:10,087::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-04 21:01:10,088::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:01:10,089::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:01:10,090::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:01:10,091::__init__::225::IOProcess::(_processLogs) (843997) Finding callback 'access'... >Thread-14::DEBUG::2014-09-04 21:01:10,092::__init__::225::IOProcess::(_processLogs) (843997) Got request for method 'access' >Thread-14::DEBUG::2014-09-04 21:01:10,093::__init__::225::IOProcess::(_processLogs) (843997) Building response >Thread-14::DEBUG::2014-09-04 21:01:10,094::__init__::225::IOProcess::(_processLogs) (843997) Queuing response >Thread-14::DEBUG::2014-09-04 21:01:10,095::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:01:10,096::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-14::DEBUG::2014-09-04 21:01:10,101::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-14::DEBUG::2014-09-04 21:01:10,101::__init__::225::IOProcess::(_processLogs) Message size is 187 >Thread-14::DEBUG::2014-09-04 21:01:10,103::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:01:10,104::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-04 21:01:10,105::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:01:10,106::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:01:10,107::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Extracting request information... >Thread-14::DEBUG::2014-09-04 21:01:10,108::__init__::225::IOProcess::(_processLogs) (843998) Finding callback 'access'... >Thread-14::DEBUG::2014-09-04 21:01:10,109::__init__::225::IOProcess::(_processLogs) (843998) Got request for method 'access' >Thread-14::DEBUG::2014-09-04 21:01:10,110::__init__::225::IOProcess::(_processLogs) (843998) Building response >Thread-14::DEBUG::2014-09-04 21:01:10,111::__init__::225::IOProcess::(_processLogs) (843998) Queuing response >Thread-14::DEBUG::2014-09-04 21:01:10,112::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:01:10,113::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-14::DEBUG::2014-09-04 21:01:10,117::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-14::DEBUG::2014-09-04 21:01:10,118::__init__::225::IOProcess::(_processLogs) Message size is 189 >Thread-14::DEBUG::2014-09-04 21:01:10,120::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:01:10,121::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-04 21:01:10,122::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:01:10,123::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:01:10,124::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Extracting request information... >Thread-14::DEBUG::2014-09-04 21:01:10,125::__init__::225::IOProcess::(_processLogs) (843999) Finding callback 'access'... >Thread-14::DEBUG::2014-09-04 21:01:10,126::__init__::225::IOProcess::(_processLogs) (843999) Got request for method 'access' >Thread-14::DEBUG::2014-09-04 21:01:10,127::__init__::225::IOProcess::(_processLogs) (843999) Building response >Thread-14::DEBUG::2014-09-04 21:01:10,128::__init__::225::IOProcess::(_processLogs) (843999) Queuing response >Thread-14::DEBUG::2014-09-04 21:01:10,129::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:01:10,130::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-41::DEBUG::2014-09-04 21:01:11,108::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/78390355-2a2d-41e5-aea5-fb426559f747/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-14::DEBUG::2014-09-04 21:01:11,434::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-14054::DEBUG::2014-09-04 21:01:11,599::BindingXMLRPC::318::vds::(wrapper) client [10.35.163.104] flowID [40a888b3] >Thread-14::DEBUG::2014-09-04 21:01:11,612::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-14054::DEBUG::2014-09-04 21:01:11,621::task::595::Storage.TaskManager.Task::(_updateState) Task=`37569931-1013-4572-a893-7f3dd1cdcd60`::moving from state init -> state preparing >Thread-14::DEBUG::2014-09-04 21:01:11,621::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14054::INFO::2014-09-04 21:01:11,627::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='78390355-2a2d-41e5-aea5-fb426559f747', options=None) >Thread-14::DEBUG::2014-09-04 21:01:11,629::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-04 21:01:11,633::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:01:11,638::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:01:11,642::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:01:11,648::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(844000) Finding callback 'statvfs'... >Thread-14054::INFO::2014-09-04 21:01:11,652::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 8L}} >Thread-14::DEBUG::2014-09-04 21:01:11,654::__init__::225::IOProcess::(_processLogs) (844000) Got request for method 'statvfs' >Thread-14054::DEBUG::2014-09-04 21:01:11,657::task::1191::Storage.TaskManager.Task::(prepare) Task=`37569931-1013-4572-a893-7f3dd1cdcd60`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 8L}} >Thread-14::DEBUG::2014-09-04 21:01:11,659::__init__::225::IOProcess::(_processLogs) (844000) Building response >Thread-14054::DEBUG::2014-09-04 21:01:11,660::task::595::Storage.TaskManager.Task::(_updateState) Task=`37569931-1013-4572-a893-7f3dd1cdcd60`::moving from state preparing -> state finished >Thread-14054::DEBUG::2014-09-04 21:01:11,663::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-09-04 21:01:11,664::__init__::225::IOProcess::(_processLogs) (844000) Queuing response >Thread-14054::DEBUG::2014-09-04 21:01:11,667::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-09-04 21:01:11,669::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14054::DEBUG::2014-09-04 21:01:11,671::task::993::Storage.TaskManager.Task::(_decref) Task=`37569931-1013-4572-a893-7f3dd1cdcd60`::ref 0 aborting False >Thread-14::DEBUG::2014-09-04 21:01:11,674::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-10379::DEBUG::2014-09-04 21:01:11,689::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mavital/7ad04229-b793-4f73-ad10-5e41a4e836ff/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Dummy-41::DEBUG::2014-09-04 21:01:11,727::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.262034 s, 3.9 MB/s\n'; <rc> = 0 >Thread-43::DEBUG::2014-09-04 21:01:12,244::BindingXMLRPC::318::vds::(wrapper) client [10.35.163.104] flowID [40a888b3] >GuestMonitor-quota__vm::DEBUG::2014-09-04 21:01:12,252::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >Thread-10379::DEBUG::2014-09-04 21:01:12,253::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n339 bytes (339 B) copied, 0.000391262 s, 866 kB/s\n'; <rc> = 0 >GuestMonitor-numa__test::DEBUG::2014-09-04 21:01:12,253::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >Thread-43::DEBUG::2014-09-04 21:01:12,259::task::595::Storage.TaskManager.Task::(_updateState) Task=`337dae79-21a6-4240-aca6-eab6ea1a2eb2`::moving from state init -> state preparing >Thread-43::INFO::2014-09-04 21:01:12,267::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='78390355-2a2d-41e5-aea5-fb426559f747', options=None) >Thread-14::DEBUG::2014-09-04 21:01:12,272::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-14::DEBUG::2014-09-04 21:01:12,282::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-14::DEBUG::2014-09-04 21:01:12,288::__init__::225::IOProcess::(_processLogs) Marshaling message... >GuestMonitor-quota__vm::DEBUG::2014-09-04 21:01:12,288::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >Thread-43::DEBUG::2014-09-04 21:01:12,288::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.78390355-2a2d-41e5-aea5-fb426559f747`ReqID=`d5720b0c-3cd4-4f27-beb4-a6a0bcde9a89`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >GuestMonitor-numa__test::DEBUG::2014-09-04 21:01:12,288::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >Thread-14::DEBUG::2014-09-04 21:01:12,291::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-43::DEBUG::2014-09-04 21:01:12,293::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.78390355-2a2d-41e5-aea5-fb426559f747' for lock type 'shared' >Thread-14::DEBUG::2014-09-04 21:01:12,296::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-43::DEBUG::2014-09-04 21:01:12,301::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.78390355-2a2d-41e5-aea5-fb426559f747' is free. Now locking as 'shared' (1 active user) >Thread-14::DEBUG::2014-09-04 21:01:12,302::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-43::DEBUG::2014-09-04 21:01:12,306::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.78390355-2a2d-41e5-aea5-fb426559f747`ReqID=`d5720b0c-3cd4-4f27-beb4-a6a0bcde9a89`::Granted request >Thread-14::DEBUG::2014-09-04 21:01:12,308::__init__::225::IOProcess::(_processLogs) Extracting request information... >GuestMonitor-quota__vm::DEBUG::2014-09-04 21:01:12,311::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >GuestMonitor-numa__test::DEBUG::2014-09-04 21:01:12,312::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >Thread-14::DEBUG::2014-09-04 21:01:12,313::__init__::225::IOProcess::(_processLogs) (844001) Finding callback 'statvfs'... >Thread-14::DEBUG::2014-09-04 21:01:12,318::__init__::225::IOProcess::(_processLogs) (844001) Got request for method 'statvfs' >Thread-43::DEBUG::2014-09-04 21:01:12,319::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`337dae79-21a6-4240-aca6-eab6ea1a2eb2`::_resourcesAcquired: Storage.78390355-2a2d-41e5-aea5-fb426559f747 (shared) >Thread-14::DEBUG::2014-09-04 21:01:12,324::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(844001) Building response >Thread-43::DEBUG::2014-09-04 21:01:12,325::task::993::Storage.TaskManager.Task::(_decref) Task=`337dae79-21a6-4240-aca6-eab6ea1a2eb2`::ref 1 aborting False >Thread-14::DEBUG::2014-09-04 21:01:12,327::__init__::225::IOProcess::(_processLogs) (844001) Queuing response >Thread-14::DEBUG::2014-09-04 21:01:12,330::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:01:12,332::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-43::INFO::2014-09-04 21:01:12,365::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': u'/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_qa_shared__iso__domain/7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 8L, 'domains': '180c43ee-5baf-41b7-87c7-c0214b51fe8f:Active,7ad04229-b793-4f73-ad10-5e41a4e836ff:Active,7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6:Active', 'master_uuid': u'180c43ee-5baf-41b7-87c7-c0214b51fe8f', 'version': '3', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'180c43ee-5baf-41b7-87c7-c0214b51fe8f': {'status': 'Active', 'diskfree': '1820606791680', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246104576', 'version': 3}, '7ad04229-b793-4f73-ad10-5e41a4e836ff': {'status': 'Active', 'diskfree': '1820606791680', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246104576', 'version': 0}, '7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6': {'status': 'Active', 'diskfree': '18881708032', 'isoprefix': u'/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_qa_shared__iso__domain/7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '652611682304', 'version': 0}}} >Thread-43::DEBUG::2014-09-04 21:01:12,365::task::1191::Storage.TaskManager.Task::(prepare) Task=`337dae79-21a6-4240-aca6-eab6ea1a2eb2`::finished: {'info': {'name': 'No Description', 'isoprefix': u'/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_qa_shared__iso__domain/7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 8L, 'domains': '180c43ee-5baf-41b7-87c7-c0214b51fe8f:Active,7ad04229-b793-4f73-ad10-5e41a4e836ff:Active,7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6:Active', 'master_uuid': u'180c43ee-5baf-41b7-87c7-c0214b51fe8f', 'version': '3', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'180c43ee-5baf-41b7-87c7-c0214b51fe8f': {'status': 'Active', 'diskfree': '1820606791680', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246104576', 'version': 3}, '7ad04229-b793-4f73-ad10-5e41a4e836ff': {'status': 'Active', 'diskfree': '1820606791680', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246104576', 'version': 0}, '7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6': {'status': 'Active', 'diskfree': '18881708032', 'isoprefix': u'/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_qa_shared__iso__domain/7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '652611682304', 'version': 0}}} >Thread-43::DEBUG::2014-09-04 21:01:12,365::task::595::Storage.TaskManager.Task::(_updateState) Task=`337dae79-21a6-4240-aca6-eab6ea1a2eb2`::moving from state preparing -> state finished >Thread-43::DEBUG::2014-09-04 21:01:12,365::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.78390355-2a2d-41e5-aea5-fb426559f747': < ResourceRef 'Storage.78390355-2a2d-41e5-aea5-fb426559f747', isValid: 'True' obj: 'None'>} >Thread-43::DEBUG::2014-09-04 21:01:12,365::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-43::DEBUG::2014-09-04 21:01:12,366::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.78390355-2a2d-41e5-aea5-fb426559f747' >Thread-43::DEBUG::2014-09-04 21:01:12,366::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.78390355-2a2d-41e5-aea5-fb426559f747' (0 active users) >Thread-43::DEBUG::2014-09-04 21:01:12,366::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.78390355-2a2d-41e5-aea5-fb426559f747' is free, finding out if anyone is waiting for it. >Thread-43::DEBUG::2014-09-04 21:01:12,366::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.78390355-2a2d-41e5-aea5-fb426559f747', Clearing records. >Thread-43::DEBUG::2014-09-04 21:01:12,366::task::993::Storage.TaskManager.Task::(_decref) Task=`337dae79-21a6-4240-aca6-eab6ea1a2eb2`::ref 0 aborting False >Dummy-41::DEBUG::2014-09-04 21:01:14,364::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/78390355-2a2d-41e5-aea5-fb426559f747/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-41::DEBUG::2014-09-04 21:01:14,745::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0127568 s, 80.3 MB/s\n'; <rc> = 0 >Dummy-41::DEBUG::2014-09-04 21:01:16,761::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/78390355-2a2d-41e5-aea5-fb426559f747/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-41::DEBUG::2014-09-04 21:01:17,139::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0125337 s, 81.7 MB/s\n'; <rc> = 0 >GuestMonitor-numa__test::DEBUG::2014-09-04 21:01:17,334::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >GuestMonitor-quota__vm::DEBUG::2014-09-04 21:01:17,336::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >GuestMonitor-numa__test::DEBUG::2014-09-04 21:01:17,340::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >GuestMonitor-quota__vm::DEBUG::2014-09-04 21:01:17,341::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >GuestMonitor-numa__test::DEBUG::2014-09-04 21:01:17,345::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >GuestMonitor-quota__vm::DEBUG::2014-09-04 21:01:17,347::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >Dummy-41::DEBUG::2014-09-04 21:01:19,236::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/78390355-2a2d-41e5-aea5-fb426559f747/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-41::DEBUG::2014-09-04 21:01:19,620::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0152144 s, 67.3 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-04 21:01:20,064::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-14::DEBUG::2014-09-04 21:01:20,064::__init__::225::IOProcess::(_processLogs) Message size is 190 >Thread-14::DEBUG::2014-09-04 21:01:20,064::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:01:20,064::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-14::DEBUG::2014-09-04 21:01:20,064::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:01:20,064::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:01:20,064::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:01:20,065::__init__::225::IOProcess::(_processLogs) (844002) Finding callback 'statvfs'... >Thread-14::DEBUG::2014-09-04 21:01:20,065::__init__::225::IOProcess::(_processLogs) (844002) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-04 21:01:20,065::__init__::225::IOProcess::(_processLogs) (844002) Building response >Thread-14::DEBUG::2014-09-04 21:01:20,065::__init__::225::IOProcess::(_processLogs) (844002) Queuing response >Thread-14::DEBUG::2014-09-04 21:01:20,065::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:01:20,065::__init__::225::IOProcess::(_processLogs) Sending response sized 329 >Thread-18::DEBUG::2014-09-04 21:01:20,066::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_qa_shared__iso__domain/7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-14::DEBUG::2014-09-04 21:01:20,378::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-09-04 21:01:20,381::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1618 bytes (1.6 kB) copied, 0.00325897 s, 496 kB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-04 21:01:20,384::__init__::225::IOProcess::(_processLogs) Message size is 166 >Thread-14::DEBUG::2014-09-04 21:01:20,389::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:01:20,393::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-04 21:01:20,397::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14054::DEBUG::2014-09-04 21:01:20,398::task::595::Storage.TaskManager.Task::(_updateState) Task=`7cba9908-e98f-4842-8381-5e33ceeee5a4`::moving from state init -> state preparing >Thread-14::DEBUG::2014-09-04 21:01:20,401::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14054::INFO::2014-09-04 21:01:20,402::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::DEBUG::2014-09-04 21:01:20,405::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:01:20,409::__init__::225::IOProcess::(_processLogs) (844003) Finding callback 'statvfs'... >Thread-14054::INFO::2014-09-04 21:01:20,410::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180c43ee-5baf-41b7-87c7-c0214b51fe8f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000339092', 'lastCheck': '10.3', 'valid': True}, '7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00113913', 'lastCheck': '10.3', 'valid': True}, '7ad04229-b793-4f73-ad10-5e41a4e836ff': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000391262', 'lastCheck': '8.1', 'valid': True}} >Thread-14::DEBUG::2014-09-04 21:01:20,413::__init__::225::IOProcess::(_processLogs) (844003) Got request for method 'statvfs' >Thread-14054::DEBUG::2014-09-04 21:01:20,415::task::1191::Storage.TaskManager.Task::(prepare) Task=`7cba9908-e98f-4842-8381-5e33ceeee5a4`::finished: {'180c43ee-5baf-41b7-87c7-c0214b51fe8f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000339092', 'lastCheck': '10.3', 'valid': True}, '7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00113913', 'lastCheck': '10.3', 'valid': True}, '7ad04229-b793-4f73-ad10-5e41a4e836ff': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000391262', 'lastCheck': '8.1', 'valid': True}} >Thread-14::DEBUG::2014-09-04 21:01:20,417::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(844003) Building response >Thread-14054::DEBUG::2014-09-04 21:01:20,418::task::595::Storage.TaskManager.Task::(_updateState) Task=`7cba9908-e98f-4842-8381-5e33ceeee5a4`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-09-04 21:01:20,421::__init__::225::IOProcess::(_processLogs) (844003) Queuing response >Thread-14054::DEBUG::2014-09-04 21:01:20,421::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-09-04 21:01:20,425::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14054::DEBUG::2014-09-04 21:01:20,425::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-09-04 21:01:20,428::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-14054::DEBUG::2014-09-04 21:01:20,430::task::993::Storage.TaskManager.Task::(_decref) Task=`7cba9908-e98f-4842-8381-5e33ceeee5a4`::ref 0 aborting False >Thread-14::DEBUG::2014-09-04 21:01:20,447::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-17::DEBUG::2014-09-04 21:01:20,450::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_artyom__storage__rhevm__35/180c43ee-5baf-41b7-87c7-c0214b51fe8f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-14::DEBUG::2014-09-04 21:01:20,452::__init__::225::IOProcess::(_processLogs) Message size is 190 >Thread-14::DEBUG::2014-09-04 21:01:20,771::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-17::DEBUG::2014-09-04 21:01:20,773::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n474 bytes (474 B) copied, 0.000362517 s, 1.3 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-04 21:01:20,775::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-04 21:01:20,779::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:01:20,781::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:01:20,783::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:01:20,786::__init__::225::IOProcess::(_processLogs) (844004) Finding callback 'statvfs'... >Thread-14::DEBUG::2014-09-04 21:01:20,788::__init__::225::IOProcess::(_processLogs) (844004) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-04 21:01:20,791::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(844004) Building response >Thread-14::DEBUG::2014-09-04 21:01:20,793::__init__::225::IOProcess::(_processLogs) (844004) Queuing response >Thread-14::DEBUG::2014-09-04 21:01:20,796::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:01:20,798::__init__::225::IOProcess::(_processLogs) Sending response sized 329 >Thread-14::DEBUG::2014-09-04 21:01:20,809::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-14::DEBUG::2014-09-04 21:01:20,812::__init__::225::IOProcess::(_processLogs) Message size is 166 >Thread-14::DEBUG::2014-09-04 21:01:20,815::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:01:20,817::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-04 21:01:20,819::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:01:20,822::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:01:20,824::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:01:20,826::__init__::225::IOProcess::(_processLogs) (844005) Finding callback 'statvfs'... >Thread-14::DEBUG::2014-09-04 21:01:20,828::__init__::225::IOProcess::(_processLogs) (844005) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-04 21:01:20,830::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(844005) Building response >Thread-14::DEBUG::2014-09-04 21:01:20,833::__init__::225::IOProcess::(_processLogs) (844005) Queuing response >Thread-14::DEBUG::2014-09-04 21:01:20,835::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:01:20,837::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-14::DEBUG::2014-09-04 21:01:20,844::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-14::DEBUG::2014-09-04 21:01:20,845::__init__::225::IOProcess::(_processLogs) Message size is 183 >Thread-14::DEBUG::2014-09-04 21:01:20,846::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:01:20,848::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-04 21:01:20,849::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:01:20,850::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:01:20,851::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:01:20,852::__init__::225::IOProcess::(_processLogs) (844006) Finding callback 'access'... >Thread-14::DEBUG::2014-09-04 21:01:20,856::__init__::225::IOProcess::(_processLogs) (844006) Got request for method 'access' >Thread-14::DEBUG::2014-09-04 21:01:20,860::__init__::225::IOProcess::(_processLogs) (844006) Building response >Thread-14::DEBUG::2014-09-04 21:01:20,864::__init__::225::IOProcess::(_processLogs) (844006) Queuing response >Thread-14054::DEBUG::2014-09-04 21:01:20,865::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >Thread-14::DEBUG::2014-09-04 21:01:20,868::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:01:20,871::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-14054::DEBUG::2014-09-04 21:01:20,877::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >Thread-14::DEBUG::2014-09-04 21:01:20,882::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-14::DEBUG::2014-09-04 21:01:20,885::__init__::225::IOProcess::(_processLogs) Message size is 187 >Thread-14::DEBUG::2014-09-04 21:01:20,888::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:01:20,891::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-04 21:01:20,895::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:01:20,898::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:01:20,901::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:01:20,904::__init__::225::IOProcess::(_processLogs) (844007) Finding callback 'access'... >Thread-14::DEBUG::2014-09-04 21:01:20,907::__init__::225::IOProcess::(_processLogs) (844007) Got request for method 'access' >Thread-14::DEBUG::2014-09-04 21:01:20,910::__init__::225::IOProcess::(_processLogs) (844007) Building response >Thread-14::DEBUG::2014-09-04 21:01:20,913::__init__::225::IOProcess::(_processLogs) (844007) Queuing response >Thread-14::DEBUG::2014-09-04 21:01:20,916::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:01:20,919::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-14::DEBUG::2014-09-04 21:01:20,929::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-14::DEBUG::2014-09-04 21:01:20,933::__init__::225::IOProcess::(_processLogs) Message size is 189 >Thread-14::DEBUG::2014-09-04 21:01:20,936::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:01:20,937::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-04 21:01:20,938::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:01:20,940::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:01:20,941::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:01:20,942::__init__::225::IOProcess::(_processLogs) (844008) Finding callback 'access'... >Thread-14::DEBUG::2014-09-04 21:01:20,943::__init__::225::IOProcess::(_processLogs) (844008) Got request for method 'access' >Thread-14::DEBUG::2014-09-04 21:01:20,944::__init__::225::IOProcess::(_processLogs) (844008) Building response >Thread-14::DEBUG::2014-09-04 21:01:20,945::__init__::225::IOProcess::(_processLogs) (844008) Queuing response >Thread-14::DEBUG::2014-09-04 21:01:20,946::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:01:20,947::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-41::DEBUG::2014-09-04 21:01:21,632::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/78390355-2a2d-41e5-aea5-fb426559f747/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-41::DEBUG::2014-09-04 21:01:22,011::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.012892 s, 79.4 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-04 21:01:22,379::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >GuestMonitor-numa__test::DEBUG::2014-09-04 21:01:22,380::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >GuestMonitor-quota__vm::DEBUG::2014-09-04 21:01:22,380::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >Thread-14::DEBUG::2014-09-04 21:01:22,382::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-14::DEBUG::2014-09-04 21:01:22,385::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:01:22,391::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14054::DEBUG::2014-09-04 21:01:22,395::BindingXMLRPC::318::vds::(wrapper) client [10.35.163.104] >Thread-14::DEBUG::2014-09-04 21:01:22,395::__init__::225::IOProcess::(_processLogs) Waiting for next request... >GuestMonitor-numa__test::DEBUG::2014-09-04 21:01:22,397::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >GuestMonitor-quota__vm::DEBUG::2014-09-04 21:01:22,398::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >Thread-14::DEBUG::2014-09-04 21:01:22,400::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14054::DEBUG::2014-09-04 21:01:22,403::task::595::Storage.TaskManager.Task::(_updateState) Task=`96e9cfc7-6348-4d97-8844-3a85dd10138a`::moving from state init -> state preparing >Thread-14::DEBUG::2014-09-04 21:01:22,404::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14054::INFO::2014-09-04 21:01:22,408::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='78390355-2a2d-41e5-aea5-fb426559f747', options=None) >Thread-14::DEBUG::2014-09-04 21:01:22,408::__init__::225::IOProcess::(_processLogs) (844009) Finding callback 'statvfs'... >Thread-14::DEBUG::2014-09-04 21:01:22,413::__init__::225::IOProcess::(_processLogs) (844009) Got request for method 'statvfs' >GuestMonitor-numa__test::DEBUG::2014-09-04 21:01:22,415::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >Thread-14::DEBUG::2014-09-04 21:01:22,416::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(844009) Building response >GuestMonitor-quota__vm::DEBUG::2014-09-04 21:01:22,418::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >Thread-14::DEBUG::2014-09-04 21:01:22,419::__init__::225::IOProcess::(_processLogs) (844009) Queuing response >Thread-14::DEBUG::2014-09-04 21:01:22,422::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:01:22,424::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-14054::INFO::2014-09-04 21:01:22,426::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 8L}} >Thread-14054::DEBUG::2014-09-04 21:01:22,427::task::1191::Storage.TaskManager.Task::(prepare) Task=`96e9cfc7-6348-4d97-8844-3a85dd10138a`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 8L}} >Thread-14054::DEBUG::2014-09-04 21:01:22,428::task::595::Storage.TaskManager.Task::(_updateState) Task=`96e9cfc7-6348-4d97-8844-3a85dd10138a`::moving from state preparing -> state finished >Thread-14054::DEBUG::2014-09-04 21:01:22,429::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10379::DEBUG::2014-09-04 21:01:22,430::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mavital/7ad04229-b793-4f73-ad10-5e41a4e836ff/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-14054::DEBUG::2014-09-04 21:01:22,430::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14054::DEBUG::2014-09-04 21:01:22,745::task::993::Storage.TaskManager.Task::(_decref) Task=`96e9cfc7-6348-4d97-8844-3a85dd10138a`::ref 0 aborting False >Thread-10379::DEBUG::2014-09-04 21:01:22,747::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n339 bytes (339 B) copied, 0.000485137 s, 699 kB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-04 21:01:22,747::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-14::DEBUG::2014-09-04 21:01:22,748::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-14::DEBUG::2014-09-04 21:01:22,748::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Marshaling message... >Thread-14::DEBUG::2014-09-04 21:01:22,748::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-04 21:01:22,748::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:01:22,748::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:01:22,748::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:01:22,749::__init__::225::IOProcess::(_processLogs) (844010) Finding callback 'statvfs'... >Thread-14::DEBUG::2014-09-04 21:01:22,749::__init__::225::IOProcess::(_processLogs) (844010) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-04 21:01:22,749::__init__::225::IOProcess::(_processLogs) (844010) Building response >Thread-14::DEBUG::2014-09-04 21:01:22,749::__init__::225::IOProcess::(_processLogs) (844010) Queuing response >Thread-14::DEBUG::2014-09-04 21:01:22,749::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:01:22,749::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-43::DEBUG::2014-09-04 21:01:22,761::BindingXMLRPC::318::vds::(wrapper) client [10.35.163.104] >Thread-43::DEBUG::2014-09-04 21:01:22,762::task::595::Storage.TaskManager.Task::(_updateState) Task=`c116c0b9-dd2c-49e3-9d28-12b63adcdb96`::moving from state init -> state preparing >Thread-43::INFO::2014-09-04 21:01:22,762::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='78390355-2a2d-41e5-aea5-fb426559f747', options=None) >Thread-43::DEBUG::2014-09-04 21:01:22,762::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.78390355-2a2d-41e5-aea5-fb426559f747`ReqID=`6e39bcad-e29a-457a-9ace-f76ed4cbc62a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-43::DEBUG::2014-09-04 21:01:22,763::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.78390355-2a2d-41e5-aea5-fb426559f747' for lock type 'shared' >Thread-43::DEBUG::2014-09-04 21:01:22,763::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.78390355-2a2d-41e5-aea5-fb426559f747' is free. Now locking as 'shared' (1 active user) >Thread-43::DEBUG::2014-09-04 21:01:22,763::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.78390355-2a2d-41e5-aea5-fb426559f747`ReqID=`6e39bcad-e29a-457a-9ace-f76ed4cbc62a`::Granted request >Thread-43::DEBUG::2014-09-04 21:01:22,763::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`c116c0b9-dd2c-49e3-9d28-12b63adcdb96`::_resourcesAcquired: Storage.78390355-2a2d-41e5-aea5-fb426559f747 (shared) >Thread-43::DEBUG::2014-09-04 21:01:22,763::task::993::Storage.TaskManager.Task::(_decref) Task=`c116c0b9-dd2c-49e3-9d28-12b63adcdb96`::ref 1 aborting False >Thread-43::INFO::2014-09-04 21:01:22,778::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': u'/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_qa_shared__iso__domain/7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 8L, 'domains': '180c43ee-5baf-41b7-87c7-c0214b51fe8f:Active,7ad04229-b793-4f73-ad10-5e41a4e836ff:Active,7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6:Active', 'master_uuid': u'180c43ee-5baf-41b7-87c7-c0214b51fe8f', 'version': '3', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'180c43ee-5baf-41b7-87c7-c0214b51fe8f': {'status': 'Active', 'diskfree': '1820606791680', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246104576', 'version': 3}, '7ad04229-b793-4f73-ad10-5e41a4e836ff': {'status': 'Active', 'diskfree': '1820606791680', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246104576', 'version': 0}, '7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6': {'status': 'Active', 'diskfree': '18881708032', 'isoprefix': u'/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_qa_shared__iso__domain/7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '652611682304', 'version': 0}}} >Thread-43::DEBUG::2014-09-04 21:01:22,779::task::1191::Storage.TaskManager.Task::(prepare) Task=`c116c0b9-dd2c-49e3-9d28-12b63adcdb96`::finished: {'info': {'name': 'No Description', 'isoprefix': u'/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_qa_shared__iso__domain/7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 8L, 'domains': '180c43ee-5baf-41b7-87c7-c0214b51fe8f:Active,7ad04229-b793-4f73-ad10-5e41a4e836ff:Active,7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6:Active', 'master_uuid': u'180c43ee-5baf-41b7-87c7-c0214b51fe8f', 'version': '3', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'180c43ee-5baf-41b7-87c7-c0214b51fe8f': {'status': 'Active', 'diskfree': '1820606791680', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246104576', 'version': 3}, '7ad04229-b793-4f73-ad10-5e41a4e836ff': {'status': 'Active', 'diskfree': '1820606791680', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246104576', 'version': 0}, '7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6': {'status': 'Active', 'diskfree': '18881708032', 'isoprefix': u'/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_qa_shared__iso__domain/7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '652611682304', 'version': 0}}} >Thread-43::DEBUG::2014-09-04 21:01:22,779::task::595::Storage.TaskManager.Task::(_updateState) Task=`c116c0b9-dd2c-49e3-9d28-12b63adcdb96`::moving from state preparing -> state finished >Thread-43::DEBUG::2014-09-04 21:01:22,779::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.78390355-2a2d-41e5-aea5-fb426559f747': < ResourceRef 'Storage.78390355-2a2d-41e5-aea5-fb426559f747', isValid: 'True' obj: 'None'>} >Thread-43::DEBUG::2014-09-04 21:01:22,779::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-43::DEBUG::2014-09-04 21:01:22,780::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.78390355-2a2d-41e5-aea5-fb426559f747' >Thread-43::DEBUG::2014-09-04 21:01:22,780::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.78390355-2a2d-41e5-aea5-fb426559f747' (0 active users) >Thread-43::DEBUG::2014-09-04 21:01:22,780::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.78390355-2a2d-41e5-aea5-fb426559f747' is free, finding out if anyone is waiting for it. >Thread-43::DEBUG::2014-09-04 21:01:22,780::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.78390355-2a2d-41e5-aea5-fb426559f747', Clearing records. >Thread-43::DEBUG::2014-09-04 21:01:22,780::task::993::Storage.TaskManager.Task::(_decref) Task=`c116c0b9-dd2c-49e3-9d28-12b63adcdb96`::ref 0 aborting False >Dummy-41::DEBUG::2014-09-04 21:01:24,030::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/78390355-2a2d-41e5-aea5-fb426559f747/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-41::DEBUG::2014-09-04 21:01:24,411::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0128992 s, 79.4 MB/s\n'; <rc> = 0 >Dummy-41::DEBUG::2014-09-04 21:01:26,436::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/78390355-2a2d-41e5-aea5-fb426559f747/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-41::DEBUG::2014-09-04 21:01:26,818::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173583 s, 59.0 MB/s\n'; <rc> = 0 >GuestMonitor-numa__test::DEBUG::2014-09-04 21:01:27,434::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >GuestMonitor-quota__vm::DEBUG::2014-09-04 21:01:27,435::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >GuestMonitor-numa__test::DEBUG::2014-09-04 21:01:27,440::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >GuestMonitor-quota__vm::DEBUG::2014-09-04 21:01:27,441::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >GuestMonitor-numa__test::DEBUG::2014-09-04 21:01:27,446::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >GuestMonitor-quota__vm::DEBUG::2014-09-04 21:01:27,446::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >Dummy-41::DEBUG::2014-09-04 21:01:28,874::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/78390355-2a2d-41e5-aea5-fb426559f747/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-41::DEBUG::2014-09-04 21:01:29,490::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.226605 s, 4.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-04 21:01:30,815::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-14::DEBUG::2014-09-04 21:01:30,815::__init__::225::IOProcess::(_processLogs) Message size is 190 >Thread-14::DEBUG::2014-09-04 21:01:30,815::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:01:30,815::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-14::DEBUG::2014-09-04 21:01:30,816::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:01:30,816::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:01:30,816::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:01:30,816::__init__::225::IOProcess::(_processLogs) (844011) Finding callback 'statvfs'... >Thread-14::DEBUG::2014-09-04 21:01:30,816::__init__::225::IOProcess::(_processLogs) (844011) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-04 21:01:30,817::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(844011) Building response >Thread-14::DEBUG::2014-09-04 21:01:30,817::__init__::225::IOProcess::(_processLogs) (844011) Queuing response >Thread-14::DEBUG::2014-09-04 21:01:30,817::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-14::DEBUG::2014-09-04 21:01:30,817::__init__::225::IOProcess::(_processLogs) Sending response sized 329 >Thread-18::DEBUG::2014-09-04 21:01:30,818::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_qa_shared__iso__domain/7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-14::DEBUG::2014-09-04 21:01:31,144::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-18::DEBUG::2014-09-04 21:01:31,144::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1618 bytes (1.6 kB) copied, 0.000998175 s, 1.6 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-04 21:01:31,148::__init__::225::IOProcess::(_processLogs) Message size is 166 >Thread-14::DEBUG::2014-09-04 21:01:31,150::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:01:31,152::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-04 21:01:31,153::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:01:31,154::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:01:31,155::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:01:31,156::__init__::225::IOProcess::(_processLogs) (844012) Finding callback 'statvfs'... >Thread-14::DEBUG::2014-09-04 21:01:31,157::__init__::225::IOProcess::(_processLogs) (844012) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-04 21:01:31,159::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(844012) Building response >Thread-14::DEBUG::2014-09-04 21:01:31,160::__init__::225::IOProcess::(_processLogs) (844012) Queuing response >Thread-14::DEBUG::2014-09-04 21:01:31,161::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:01:31,162::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-14::DEBUG::2014-09-04 21:01:31,168::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-17::DEBUG::2014-09-04 21:01:31,171::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_artyom__storage__rhevm__35/180c43ee-5baf-41b7-87c7-c0214b51fe8f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-14::DEBUG::2014-09-04 21:01:31,171::__init__::225::IOProcess::(_processLogs) Message size is 190 >VM Channels Listener::DEBUG::2014-09-04 21:01:31,491::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 44. >Thread-14::DEBUG::2014-09-04 21:01:31,492::__init__::225::IOProcess::(_processLogs) Marshaling message... >VM Channels Listener::DEBUG::2014-09-04 21:01:31,498::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 57. >Thread-14::DEBUG::2014-09-04 21:01:31,499::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-17::DEBUG::2014-09-04 21:01:31,500::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n474 bytes (474 B) copied, 0.000322821 s, 1.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-04 21:01:31,507::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Dummy-41::DEBUG::2014-09-04 21:01:31,510::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/78390355-2a2d-41e5-aea5-fb426559f747/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-14::DEBUG::2014-09-04 21:01:31,513::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:01:31,852::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:01:31,856::__init__::225::IOProcess::(_processLogs) (844013) Finding callback 'statvfs'... >Thread-14::DEBUG::2014-09-04 21:01:31,861::__init__::225::IOProcess::(_processLogs) (844013) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-04 21:01:31,866::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(844013) Building response >Thread-14::DEBUG::2014-09-04 21:01:31,871::__init__::225::IOProcess::(_processLogs) (844013) Queuing response >Thread-14::DEBUG::2014-09-04 21:01:31,875::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:01:31,879::__init__::225::IOProcess::(_processLogs) Sending response sized 329 >Thread-14::DEBUG::2014-09-04 21:01:31,900::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-14::DEBUG::2014-09-04 21:01:31,906::__init__::225::IOProcess::(_processLogs) Message size is 166 >Thread-14::DEBUG::2014-09-04 21:01:31,910::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:01:31,914::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-04 21:01:31,917::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:01:31,920::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:01:31,922::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:01:31,924::__init__::225::IOProcess::(_processLogs) (844014) Finding callback 'statvfs'... >Thread-14::DEBUG::2014-09-04 21:01:31,927::__init__::225::IOProcess::(_processLogs) (844014) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-04 21:01:31,929::__init__::225::IOProcess::(_processLogs) (844014) Building response >Thread-14::DEBUG::2014-09-04 21:01:31,931::__init__::225::IOProcess::(_processLogs) (844014) Queuing response >Thread-14::DEBUG::2014-09-04 21:01:31,934::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:01:31,936::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Dummy-41::DEBUG::2014-09-04 21:01:31,977::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0898331 s, 11.4 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-04 21:01:31,984::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-14::DEBUG::2014-09-04 21:01:31,986::__init__::225::IOProcess::(_processLogs) Message size is 183 >Thread-14::DEBUG::2014-09-04 21:01:31,988::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:01:31,990::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-04 21:01:31,991::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:01:31,993::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:01:31,995::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:01:31,996::__init__::225::IOProcess::(_processLogs) (844015) Finding callback 'access'... >Thread-14::DEBUG::2014-09-04 21:01:31,998::__init__::225::IOProcess::(_processLogs) (844015) Got request for method 'access' >Thread-14::DEBUG::2014-09-04 21:01:32,000::__init__::225::IOProcess::(_processLogs) (844015) Building response >Thread-14::DEBUG::2014-09-04 21:01:32,002::__init__::225::IOProcess::(_processLogs) (844015) Queuing response >Thread-14::DEBUG::2014-09-04 21:01:32,004::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:01:32,006::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-14::DEBUG::2014-09-04 21:01:32,011::__init__::225::IOProcess::(_processLogs) (844015) Got request for method 'access'DEBUG|Receiving request... >Thread-14::DEBUG::2014-09-04 21:01:32,013::__init__::225::IOProcess::(_processLogs) Message size is 187 >Thread-14::DEBUG::2014-09-04 21:01:32,015::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:01:32,017::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-04 21:01:32,019::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:01:32,021::__init__::225::IOProcess::(_processLogs) (844015) Got request for method 'access'DEBUG|Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:01:32,023::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:01:32,025::__init__::225::IOProcess::(_processLogs) (844016) Finding callback 'access'... >Thread-14::DEBUG::2014-09-04 21:01:32,026::__init__::225::IOProcess::(_processLogs) (844016) Got request for method 'access' >Thread-14::DEBUG::2014-09-04 21:01:32,028::__init__::225::IOProcess::(_processLogs) (844016) Building response >Thread-14::DEBUG::2014-09-04 21:01:32,030::__init__::225::IOProcess::(_processLogs) (844016) Queuing response >Thread-14::DEBUG::2014-09-04 21:01:32,032::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:01:32,034::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-14::DEBUG::2014-09-04 21:01:32,040::__init__::225::IOProcess::(_processLogs) (844015) Got request for method 'access'DEBUG|Receiving request... >Thread-14::DEBUG::2014-09-04 21:01:32,042::__init__::225::IOProcess::(_processLogs) Message size is 189 >Thread-14::DEBUG::2014-09-04 21:01:32,044::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:01:32,045::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-04 21:01:32,048::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:01:32,050::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:01:32,051::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:01:32,054::__init__::225::IOProcess::(_processLogs) (844015) Got request for method 'access'DEBUG|(844017) Finding callback 'access'... >Thread-14::DEBUG::2014-09-04 21:01:32,055::__init__::225::IOProcess::(_processLogs) (844017) Got request for method 'access' >Thread-14::DEBUG::2014-09-04 21:01:32,057::__init__::225::IOProcess::(_processLogs) (844017) Building response >Thread-14::DEBUG::2014-09-04 21:01:32,059::__init__::225::IOProcess::(_processLogs) (844017) Queuing response >Thread-14::DEBUG::2014-09-04 21:01:32,060::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:01:32,062::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >GuestMonitor-numa__test::DEBUG::2014-09-04 21:01:32,458::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >GuestMonitor-quota__vm::DEBUG::2014-09-04 21:01:32,459::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >GuestMonitor-numa__test::DEBUG::2014-09-04 21:01:32,464::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >GuestMonitor-quota__vm::DEBUG::2014-09-04 21:01:32,465::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >GuestMonitor-numa__test::DEBUG::2014-09-04 21:01:32,469::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >GuestMonitor-quota__vm::DEBUG::2014-09-04 21:01:32,470::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >Thread-14::DEBUG::2014-09-04 21:01:32,751::__init__::225::IOProcess::(_processLogs) (844015) Got request for method 'access'DEBUG|Receiving request... >Thread-14::DEBUG::2014-09-04 21:01:32,751::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-14::DEBUG::2014-09-04 21:01:32,751::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:01:32,752::__init__::225::IOProcess::(_processLogs) (844015) Got request for method 'access'DEBUG|Queuing request... >Thread-14::DEBUG::2014-09-04 21:01:32,752::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:01:32,752::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:01:32,752::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:01:32,752::__init__::225::IOProcess::(_processLogs) (844018) Finding callback 'statvfs'... >Thread-14::DEBUG::2014-09-04 21:01:32,752::__init__::225::IOProcess::(_processLogs) (844018) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-04 21:01:32,752::__init__::225::IOProcess::(_processLogs) (844015) Got request for method 'access'DEBUG|(844018) Building response >Thread-14::DEBUG::2014-09-04 21:01:32,752::__init__::225::IOProcess::(_processLogs) (844018) Queuing response >Thread-14::DEBUG::2014-09-04 21:01:32,753::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:01:32,753::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-10379::DEBUG::2014-09-04 21:01:32,753::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mavital/7ad04229-b793-4f73-ad10-5e41a4e836ff/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-10379::DEBUG::2014-09-04 21:01:33,085::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n339 bytes (339 B) copied, 0.000324655 s, 1.0 MB/s\n'; <rc> = 0 >Thread-14054::DEBUG::2014-09-04 21:01:33,089::BindingXMLRPC::318::vds::(wrapper) client [10.35.163.104] flowID [26afd955] >Thread-14::DEBUG::2014-09-04 21:01:33,093::__init__::225::IOProcess::(_processLogs) (844015) Got request for method 'access'DEBUG|Receiving request... >Thread-14::DEBUG::2014-09-04 21:01:33,097::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-14054::DEBUG::2014-09-04 21:01:33,097::task::595::Storage.TaskManager.Task::(_updateState) Task=`dd8f855f-2cf9-4399-afbe-cb2cdf5e3312`::moving from state init -> state preparing >Thread-14::DEBUG::2014-09-04 21:01:33,099::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14054::INFO::2014-09-04 21:01:33,100::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='78390355-2a2d-41e5-aea5-fb426559f747', options=None) >Thread-14::DEBUG::2014-09-04 21:01:33,102::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-04 21:01:33,103::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:01:33,103::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:01:33,103::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:01:33,103::__init__::225::IOProcess::(_processLogs) (844019) Finding callback 'statvfs'... >Thread-14::DEBUG::2014-09-04 21:01:33,103::__init__::225::IOProcess::(_processLogs) (844019) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-04 21:01:33,104::__init__::225::IOProcess::(_processLogs) (844015) Got request for method 'access'DEBUG|(844019) Building response >Thread-14::DEBUG::2014-09-04 21:01:33,104::__init__::225::IOProcess::(_processLogs) (844019) Queuing response >Thread-14::DEBUG::2014-09-04 21:01:33,104::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:01:33,104::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-14054::INFO::2014-09-04 21:01:33,115::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 8L}} >Thread-14054::DEBUG::2014-09-04 21:01:33,115::task::1191::Storage.TaskManager.Task::(prepare) Task=`dd8f855f-2cf9-4399-afbe-cb2cdf5e3312`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 8L}} >Thread-14054::DEBUG::2014-09-04 21:01:33,115::task::595::Storage.TaskManager.Task::(_updateState) Task=`dd8f855f-2cf9-4399-afbe-cb2cdf5e3312`::moving from state preparing -> state finished >Thread-14054::DEBUG::2014-09-04 21:01:33,115::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14054::DEBUG::2014-09-04 21:01:33,115::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14054::DEBUG::2014-09-04 21:01:33,115::task::993::Storage.TaskManager.Task::(_decref) Task=`dd8f855f-2cf9-4399-afbe-cb2cdf5e3312`::ref 0 aborting False >Thread-43::DEBUG::2014-09-04 21:01:33,128::BindingXMLRPC::318::vds::(wrapper) client [10.35.163.104] flowID [26afd955] >Thread-43::DEBUG::2014-09-04 21:01:33,129::task::595::Storage.TaskManager.Task::(_updateState) Task=`4c96d97f-10d0-4597-91ae-bac5d797e70c`::moving from state init -> state preparing >Thread-43::INFO::2014-09-04 21:01:33,129::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='78390355-2a2d-41e5-aea5-fb426559f747', options=None) >Thread-43::DEBUG::2014-09-04 21:01:33,130::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.78390355-2a2d-41e5-aea5-fb426559f747`ReqID=`1afa7b49-43d1-471f-a6af-7e384755017d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-43::DEBUG::2014-09-04 21:01:33,130::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.78390355-2a2d-41e5-aea5-fb426559f747' for lock type 'shared' >Thread-43::DEBUG::2014-09-04 21:01:33,130::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.78390355-2a2d-41e5-aea5-fb426559f747' is free. Now locking as 'shared' (1 active user) >Thread-43::DEBUG::2014-09-04 21:01:33,130::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.78390355-2a2d-41e5-aea5-fb426559f747`ReqID=`1afa7b49-43d1-471f-a6af-7e384755017d`::Granted request >Thread-43::DEBUG::2014-09-04 21:01:33,130::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`4c96d97f-10d0-4597-91ae-bac5d797e70c`::_resourcesAcquired: Storage.78390355-2a2d-41e5-aea5-fb426559f747 (shared) >Thread-43::DEBUG::2014-09-04 21:01:33,130::task::993::Storage.TaskManager.Task::(_decref) Task=`4c96d97f-10d0-4597-91ae-bac5d797e70c`::ref 1 aborting False >Thread-43::INFO::2014-09-04 21:01:33,145::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': u'/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_qa_shared__iso__domain/7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 8L, 'domains': '180c43ee-5baf-41b7-87c7-c0214b51fe8f:Active,7ad04229-b793-4f73-ad10-5e41a4e836ff:Active,7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6:Active', 'master_uuid': u'180c43ee-5baf-41b7-87c7-c0214b51fe8f', 'version': '3', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'180c43ee-5baf-41b7-87c7-c0214b51fe8f': {'status': 'Active', 'diskfree': '1820606660608', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246104576', 'version': 3}, '7ad04229-b793-4f73-ad10-5e41a4e836ff': {'status': 'Active', 'diskfree': '1820606660608', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246104576', 'version': 0}, '7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6': {'status': 'Active', 'diskfree': '18881708032', 'isoprefix': u'/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_qa_shared__iso__domain/7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '652611682304', 'version': 0}}} >Thread-43::DEBUG::2014-09-04 21:01:33,145::task::1191::Storage.TaskManager.Task::(prepare) Task=`4c96d97f-10d0-4597-91ae-bac5d797e70c`::finished: {'info': {'name': 'No Description', 'isoprefix': u'/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_qa_shared__iso__domain/7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 8L, 'domains': '180c43ee-5baf-41b7-87c7-c0214b51fe8f:Active,7ad04229-b793-4f73-ad10-5e41a4e836ff:Active,7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6:Active', 'master_uuid': u'180c43ee-5baf-41b7-87c7-c0214b51fe8f', 'version': '3', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'180c43ee-5baf-41b7-87c7-c0214b51fe8f': {'status': 'Active', 'diskfree': '1820606660608', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246104576', 'version': 3}, '7ad04229-b793-4f73-ad10-5e41a4e836ff': {'status': 'Active', 'diskfree': '1820606660608', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246104576', 'version': 0}, '7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6': {'status': 'Active', 'diskfree': '18881708032', 'isoprefix': u'/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_qa_shared__iso__domain/7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '652611682304', 'version': 0}}} >Thread-43::DEBUG::2014-09-04 21:01:33,146::task::595::Storage.TaskManager.Task::(_updateState) Task=`4c96d97f-10d0-4597-91ae-bac5d797e70c`::moving from state preparing -> state finished >Thread-43::DEBUG::2014-09-04 21:01:33,146::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.78390355-2a2d-41e5-aea5-fb426559f747': < ResourceRef 'Storage.78390355-2a2d-41e5-aea5-fb426559f747', isValid: 'True' obj: 'None'>} >Thread-43::DEBUG::2014-09-04 21:01:33,146::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-43::DEBUG::2014-09-04 21:01:33,146::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.78390355-2a2d-41e5-aea5-fb426559f747' >Thread-43::DEBUG::2014-09-04 21:01:33,146::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.78390355-2a2d-41e5-aea5-fb426559f747' (0 active users) >Thread-43::DEBUG::2014-09-04 21:01:33,146::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.78390355-2a2d-41e5-aea5-fb426559f747' is free, finding out if anyone is waiting for it. >Thread-43::DEBUG::2014-09-04 21:01:33,146::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.78390355-2a2d-41e5-aea5-fb426559f747', Clearing records. >Thread-43::DEBUG::2014-09-04 21:01:33,147::task::993::Storage.TaskManager.Task::(_decref) Task=`4c96d97f-10d0-4597-91ae-bac5d797e70c`::ref 0 aborting False >Dummy-41::DEBUG::2014-09-04 21:01:34,202::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/78390355-2a2d-41e5-aea5-fb426559f747/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-41::DEBUG::2014-09-04 21:01:34,563::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0124823 s, 82.0 MB/s\n'; <rc> = 0 >Thread-9196::DEBUG::2014-09-04 21:01:35,141::task::595::Storage.TaskManager.Task::(_updateState) Task=`85983ec2-7acd-4c41-b20c-04593913e5d7`::moving from state init -> state preparing >Thread-9196::INFO::2014-09-04 21:01:35,142::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='180c43ee-5baf-41b7-87c7-c0214b51fe8f', spUUID='78390355-2a2d-41e5-aea5-fb426559f747', imgUUID='e8bb0473-2d86-4f1c-9d82-2c9690c52427', volUUID='bed5a4ba-eae0-49bf-a6b2-be81e7c21100', options=None) >Thread-14::DEBUG::2014-09-04 21:01:35,144::__init__::225::IOProcess::(_processLogs) (844015) Got request for method 'access'DEBUG|Receiving request... >Thread-14::DEBUG::2014-09-04 21:01:35,145::__init__::225::IOProcess::(_processLogs) Message size is 244 >Thread-14::DEBUG::2014-09-04 21:01:35,145::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:01:35,145::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-04 21:01:35,145::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:01:35,145::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:01:35,145::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:01:35,145::__init__::225::IOProcess::(_processLogs) (844020) Finding callback 'stat'... >Thread-14::DEBUG::2014-09-04 21:01:35,146::__init__::225::IOProcess::(_processLogs) (844020) Got request for method 'stat' >Thread-14::DEBUG::2014-09-04 21:01:35,146::__init__::225::IOProcess::(_processLogs) (844020) Queuing response >Thread-14::DEBUG::2014-09-04 21:01:35,146::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:01:35,146::__init__::225::IOProcess::(_processLogs) Sending response sized 327 >Thread-14::DEBUG::2014-09-04 21:01:35,147::__init__::225::IOProcess::(_processLogs) Message size is 244 >Thread-14::DEBUG::2014-09-04 21:01:35,147::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:01:35,148::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:01:35,149::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:01:35,149::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:01:35,149::__init__::225::IOProcess::(_processLogs) (844021) Finding callback 'stat'... >Thread-14::DEBUG::2014-09-04 21:01:35,149::__init__::225::IOProcess::(_processLogs) (844021) Got request for method 'stat' >Thread-14::DEBUG::2014-09-04 21:01:35,149::__init__::225::IOProcess::(_processLogs) (844021) Building response >Thread-14::DEBUG::2014-09-04 21:01:35,149::__init__::225::IOProcess::(_processLogs) (844021) Queuing response >Thread-14::DEBUG::2014-09-04 21:01:35,149::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:01:35,149::__init__::225::IOProcess::(_processLogs) Sending response sized 327 >Thread-9196::INFO::2014-09-04 21:01:35,150::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '24576', 'apparentsize': '1073741824'} >Thread-9196::DEBUG::2014-09-04 21:01:35,150::task::1191::Storage.TaskManager.Task::(prepare) Task=`85983ec2-7acd-4c41-b20c-04593913e5d7`::finished: {'truesize': '24576', 'apparentsize': '1073741824'} >Thread-9196::DEBUG::2014-09-04 21:01:35,150::task::595::Storage.TaskManager.Task::(_updateState) Task=`85983ec2-7acd-4c41-b20c-04593913e5d7`::moving from state preparing -> state finished >Thread-9196::DEBUG::2014-09-04 21:01:35,151::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-9196::DEBUG::2014-09-04 21:01:35,151::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-9196::DEBUG::2014-09-04 21:01:35,151::task::993::Storage.TaskManager.Task::(_decref) Task=`85983ec2-7acd-4c41-b20c-04593913e5d7`::ref 0 aborting False >Thread-14054::DEBUG::2014-09-04 21:01:36,113::task::595::Storage.TaskManager.Task::(_updateState) Task=`85fd3e95-c4d7-4d90-b2d3-52402b221265`::moving from state init -> state preparing >Thread-14054::INFO::2014-09-04 21:01:36,113::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14054::INFO::2014-09-04 21:01:36,113::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180c43ee-5baf-41b7-87c7-c0214b51fe8f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000322821', 'lastCheck': '4.0', 'valid': True}, '7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000998175', 'lastCheck': '4.2', 'valid': True}, '7ad04229-b793-4f73-ad10-5e41a4e836ff': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000324655', 'lastCheck': '3.0', 'valid': True}} >Thread-14054::DEBUG::2014-09-04 21:01:36,114::task::1191::Storage.TaskManager.Task::(prepare) Task=`85fd3e95-c4d7-4d90-b2d3-52402b221265`::finished: {'180c43ee-5baf-41b7-87c7-c0214b51fe8f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000322821', 'lastCheck': '4.0', 'valid': True}, '7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000998175', 'lastCheck': '4.2', 'valid': True}, '7ad04229-b793-4f73-ad10-5e41a4e836ff': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000324655', 'lastCheck': '3.0', 'valid': True}} >Thread-14054::DEBUG::2014-09-04 21:01:36,114::task::595::Storage.TaskManager.Task::(_updateState) Task=`85fd3e95-c4d7-4d90-b2d3-52402b221265`::moving from state preparing -> state finished >Thread-14054::DEBUG::2014-09-04 21:01:36,114::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14054::DEBUG::2014-09-04 21:01:36,114::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14054::DEBUG::2014-09-04 21:01:36,114::task::993::Storage.TaskManager.Task::(_decref) Task=`85fd3e95-c4d7-4d90-b2d3-52402b221265`::ref 0 aborting False >Thread-14054::DEBUG::2014-09-04 21:01:36,137::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >Thread-14054::DEBUG::2014-09-04 21:01:36,137::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >Dummy-41::DEBUG::2014-09-04 21:01:36,575::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/78390355-2a2d-41e5-aea5-fb426559f747/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-41::DEBUG::2014-09-04 21:01:36,938::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0127527 s, 80.3 MB/s\n'; <rc> = 0 >GuestMonitor-numa__test::DEBUG::2014-09-04 21:01:37,481::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >GuestMonitor-quota__vm::DEBUG::2014-09-04 21:01:37,483::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >GuestMonitor-numa__test::DEBUG::2014-09-04 21:01:37,487::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >GuestMonitor-quota__vm::DEBUG::2014-09-04 21:01:37,488::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >GuestMonitor-numa__test::DEBUG::2014-09-04 21:01:37,492::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >GuestMonitor-quota__vm::DEBUG::2014-09-04 21:01:37,494::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >Dummy-41::DEBUG::2014-09-04 21:01:38,950::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/78390355-2a2d-41e5-aea5-fb426559f747/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-9209::DEBUG::2014-09-04 21:01:39,258::task::595::Storage.TaskManager.Task::(_updateState) Task=`31d92a12-3648-48bb-8282-4a4248aa263d`::moving from state init -> state preparing >Thread-9209::INFO::2014-09-04 21:01:39,261::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='180c43ee-5baf-41b7-87c7-c0214b51fe8f', spUUID='78390355-2a2d-41e5-aea5-fb426559f747', imgUUID='70069763-69d2-42a9-86e7-23db8019e0b3', volUUID='0f679bfe-49c1-4e90-b02a-4f075a42fda5', options=None) >Thread-14::DEBUG::2014-09-04 21:01:39,268::__init__::225::IOProcess::(_processLogs) Message size is 244 >Thread-14::DEBUG::2014-09-04 21:01:39,268::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:01:39,269::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-04 21:01:39,270::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:01:39,271::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:01:39,272::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:01:39,272::__init__::225::IOProcess::(_processLogs) (844022) Finding callback 'stat'... >Thread-14::DEBUG::2014-09-04 21:01:39,273::__init__::225::IOProcess::(_processLogs) (844022) Got request for method 'stat' >Thread-14::DEBUG::2014-09-04 21:01:39,274::__init__::225::IOProcess::(_processLogs) (844022) Queuing response >Thread-14::DEBUG::2014-09-04 21:01:39,275::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:01:39,276::__init__::225::IOProcess::(_processLogs) Sending response sized 327 >Thread-14::DEBUG::2014-09-04 21:01:39,281::__init__::225::IOProcess::(_processLogs) Message size is 244 >Thread-14::DEBUG::2014-09-04 21:01:39,282::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:01:39,282::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-04 21:01:39,283::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:01:39,284::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:01:39,285::__init__::225::IOProcess::(_processLogs) (844023) Finding callback 'stat'... >Thread-14::DEBUG::2014-09-04 21:01:39,286::__init__::225::IOProcess::(_processLogs) (844023) Got request for method 'stat' >Thread-14::DEBUG::2014-09-04 21:01:39,287::__init__::225::IOProcess::(_processLogs) (844023) Building response >Thread-14::DEBUG::2014-09-04 21:01:39,287::__init__::225::IOProcess::(_processLogs) (844023) Queuing response >Thread-14::DEBUG::2014-09-04 21:01:39,288::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:01:39,289::__init__::225::IOProcess::(_processLogs) Sending response sized 327 >Dummy-41::DEBUG::2014-09-04 21:01:39,327::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0362105 s, 28.3 MB/s\n'; <rc> = 0 >Thread-9209::INFO::2014-09-04 21:01:39,327::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '24576', 'apparentsize': '1073741824'} >Thread-9209::DEBUG::2014-09-04 21:01:39,329::task::1191::Storage.TaskManager.Task::(prepare) Task=`31d92a12-3648-48bb-8282-4a4248aa263d`::finished: {'truesize': '24576', 'apparentsize': '1073741824'} >Thread-9209::DEBUG::2014-09-04 21:01:39,329::task::595::Storage.TaskManager.Task::(_updateState) Task=`31d92a12-3648-48bb-8282-4a4248aa263d`::moving from state preparing -> state finished >Thread-9209::DEBUG::2014-09-04 21:01:39,330::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-9209::DEBUG::2014-09-04 21:01:39,331::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-9209::DEBUG::2014-09-04 21:01:39,331::task::993::Storage.TaskManager.Task::(_decref) Task=`31d92a12-3648-48bb-8282-4a4248aa263d`::ref 0 aborting False >Dummy-41::DEBUG::2014-09-04 21:01:41,344::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/78390355-2a2d-41e5-aea5-fb426559f747/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-41::DEBUG::2014-09-04 21:01:41,707::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0128983 s, 79.4 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-04 21:01:41,905::__init__::225::IOProcess::(_processLogs) Message size is 190 >Thread-14::DEBUG::2014-09-04 21:01:41,905::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:01:41,906::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-04 21:01:41,906::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:01:41,906::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:01:41,906::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:01:41,906::__init__::225::IOProcess::(_processLogs) (844024) Finding callback 'statvfs'... >Thread-14::DEBUG::2014-09-04 21:01:41,906::__init__::225::IOProcess::(_processLogs) (844024) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-04 21:01:41,906::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(844024) Building response >Thread-14::DEBUG::2014-09-04 21:01:41,907::__init__::225::IOProcess::(_processLogs) (844024) Queuing response >Thread-14::DEBUG::2014-09-04 21:01:41,907::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:01:41,907::__init__::225::IOProcess::(_processLogs) Sending response sized 329 >Thread-18::DEBUG::2014-09-04 21:01:41,908::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_qa_shared__iso__domain/7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-14::DEBUG::2014-09-04 21:01:42,232::__init__::225::IOProcess::(_processLogs) Message size is 166 >Thread-18::DEBUG::2014-09-04 21:01:42,234::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1581 bytes (1.6 kB) copied, 0.000935353 s, 1.7 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-04 21:01:42,238::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:01:42,241::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-04 21:01:42,244::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:01:42,246::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:01:42,249::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:01:42,251::__init__::225::IOProcess::(_processLogs) (844025) Finding callback 'statvfs'... >Thread-14::DEBUG::2014-09-04 21:01:42,254::__init__::225::IOProcess::(_processLogs) (844025) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-04 21:01:42,256::__init__::225::IOProcess::(_processLogs) (844025) Queuing response >Thread-14::DEBUG::2014-09-04 21:01:42,258::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:01:42,261::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-14::DEBUG::2014-09-04 21:01:42,272::__init__::225::IOProcess::(_processLogs) Message size is 190 >Thread-17::DEBUG::2014-09-04 21:01:42,276::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_artyom__storage__rhevm__35/180c43ee-5baf-41b7-87c7-c0214b51fe8f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-14::DEBUG::2014-09-04 21:01:42,277::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:01:42,611::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-04 21:01:42,622::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-17::DEBUG::2014-09-04 21:01:42,624::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n474 bytes (474 B) copied, 0.000366957 s, 1.3 MB/s\n'; <rc> = 0 >GuestMonitor-numa__test::DEBUG::2014-09-04 21:01:42,624::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >GuestMonitor-quota__vm::DEBUG::2014-09-04 21:01:42,627::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >Thread-14::DEBUG::2014-09-04 21:01:42,631::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:01:42,641::__init__::225::IOProcess::(_processLogs) (844026) Finding callback 'statvfs'... >Thread-14::DEBUG::2014-09-04 21:01:42,648::__init__::225::IOProcess::(_processLogs) (844026) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-04 21:01:42,653::__init__::225::IOProcess::(_processLogs) (844026) Building response >GuestMonitor-numa__test::DEBUG::2014-09-04 21:01:42,653::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >GuestMonitor-quota__vm::DEBUG::2014-09-04 21:01:42,655::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >Thread-14::DEBUG::2014-09-04 21:01:42,657::__init__::225::IOProcess::(_processLogs) (844026) Queuing response >Thread-14::DEBUG::2014-09-04 21:01:42,661::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:01:42,665::__init__::225::IOProcess::(_processLogs) Sending response sized 329 >GuestMonitor-numa__test::DEBUG::2014-09-04 21:01:42,672::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >GuestMonitor-quota__vm::DEBUG::2014-09-04 21:01:42,674::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >Thread-14::DEBUG::2014-09-04 21:01:42,684::__init__::225::IOProcess::(_processLogs) Message size is 166 >Thread-14::DEBUG::2014-09-04 21:01:42,688::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:01:42,690::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-04 21:01:42,691::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:01:42,692::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:01:42,692::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:01:42,693::__init__::225::IOProcess::(_processLogs) (844027) Finding callback 'statvfs'... >Thread-14::DEBUG::2014-09-04 21:01:42,694::__init__::225::IOProcess::(_processLogs) (844027) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-04 21:01:42,695::__init__::225::IOProcess::(_processLogs) (844027) Queuing response >Thread-14::DEBUG::2014-09-04 21:01:42,696::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:01:42,697::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-14::DEBUG::2014-09-04 21:01:42,703::__init__::225::IOProcess::(_processLogs) Message size is 183 >Thread-14::DEBUG::2014-09-04 21:01:42,704::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:01:42,705::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-04 21:01:42,706::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:01:42,707::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:01:42,708::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:01:42,708::__init__::225::IOProcess::(_processLogs) (844028) Finding callback 'access'... >Thread-14::DEBUG::2014-09-04 21:01:42,709::__init__::225::IOProcess::(_processLogs) (844028) Got request for method 'access' >Thread-14::DEBUG::2014-09-04 21:01:42,710::__init__::225::IOProcess::(_processLogs) (844028) Queuing response >Thread-14::DEBUG::2014-09-04 21:01:42,711::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:01:42,712::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-14::DEBUG::2014-09-04 21:01:42,715::__init__::225::IOProcess::(_processLogs) Message size is 187 >Thread-14::DEBUG::2014-09-04 21:01:42,716::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:01:42,717::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-04 21:01:42,717::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:01:42,718::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:01:42,719::__init__::225::IOProcess::(_processLogs) (844029) Finding callback 'access'... >Thread-14::DEBUG::2014-09-04 21:01:42,720::__init__::225::IOProcess::(_processLogs) (844029) Got request for method 'access' >Thread-14::DEBUG::2014-09-04 21:01:42,721::__init__::225::IOProcess::(_processLogs) (844029) Building response >Thread-14::DEBUG::2014-09-04 21:01:42,722::__init__::225::IOProcess::(_processLogs) (844029) Queuing response >Thread-14::DEBUG::2014-09-04 21:01:42,723::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:01:42,724::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-14::DEBUG::2014-09-04 21:01:42,727::__init__::225::IOProcess::(_processLogs) Message size is 189 >Thread-14::DEBUG::2014-09-04 21:01:42,727::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:01:42,728::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-04 21:01:42,729::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:01:42,730::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:01:42,731::__init__::225::IOProcess::(_processLogs) (844030) Finding callback 'access'... >Thread-14::DEBUG::2014-09-04 21:01:42,732::__init__::225::IOProcess::(_processLogs) (844030) Got request for method 'access' >Thread-14::DEBUG::2014-09-04 21:01:42,733::__init__::225::IOProcess::(_processLogs) (844030) Building response >Thread-14::DEBUG::2014-09-04 21:01:42,733::__init__::225::IOProcess::(_processLogs) (844030) Queuing response >Thread-14::DEBUG::2014-09-04 21:01:42,734::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:01:42,735::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-10379::DEBUG::2014-09-04 21:01:43,107::domainMonitor::209::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 7ad04229-b793-4f73-ad10-5e41a4e836ff >Thread-14::DEBUG::2014-09-04 21:01:43,109::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-14::DEBUG::2014-09-04 21:01:43,110::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:01:43,110::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:01:43,110::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:01:43,110::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:01:43,111::__init__::225::IOProcess::(_processLogs) (844031) Finding callback 'glob'... >Thread-14::DEBUG::2014-09-04 21:01:43,111::__init__::225::IOProcess::(_processLogs) (844031) Got request for method 'glob' >Thread-14::DEBUG::2014-09-04 21:01:43,111::__init__::225::IOProcess::(_processLogs) (844031) Building response >Thread-14::DEBUG::2014-09-04 21:01:43,111::__init__::225::IOProcess::(_processLogs) (844031) Queuing response >Thread-14::DEBUG::2014-09-04 21:01:43,112::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:01:43,114::__init__::225::IOProcess::(_processLogs) Sending response sized 220 >Thread-14::DEBUG::2014-09-04 21:01:43,116::__init__::225::IOProcess::(_processLogs) Message size is 127 >Thread-14::DEBUG::2014-09-04 21:01:43,116::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:01:43,116::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:01:43,116::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:01:43,116::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:01:43,117::__init__::225::IOProcess::(_processLogs) (844032) Finding callback 'glob'... >Thread-14::DEBUG::2014-09-04 21:01:43,117::__init__::225::IOProcess::(_processLogs) (844032) Got request for method 'glob' >Thread-14::DEBUG::2014-09-04 21:01:43,117::__init__::225::IOProcess::(_processLogs) (844032) Building response >Thread-14::DEBUG::2014-09-04 21:01:43,117::__init__::225::IOProcess::(_processLogs) (844032) Queuing response >Thread-14::DEBUG::2014-09-04 21:01:43,117::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:01:43,117::__init__::225::IOProcess::(_processLogs) Sending response sized 177 >Thread-14::DEBUG::2014-09-04 21:01:43,118::__init__::225::IOProcess::(_processLogs) Message size is 146 >Thread-14::DEBUG::2014-09-04 21:01:43,119::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:01:43,121::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-04 21:01:43,122::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:01:43,123::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:01:43,124::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:01:43,125::__init__::225::IOProcess::(_processLogs) (844033) Finding callback 'glob'... >Thread-14::DEBUG::2014-09-04 21:01:43,126::__init__::225::IOProcess::(_processLogs) (844033) Got request for method 'glob' >Thread-14::DEBUG::2014-09-04 21:01:43,128::__init__::225::IOProcess::(_processLogs) (844033) Queuing response >Thread-14::DEBUG::2014-09-04 21:01:43,129::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:01:43,130::__init__::225::IOProcess::(_processLogs) Sending response sized 196 >Thread-10379::DEBUG::2014-09-04 21:01:43,134::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_mavital/7ad04229-b793-4f73-ad10-5e41a4e836ff >Thread-14::DEBUG::2014-09-04 21:01:43,135::__init__::225::IOProcess::(_processLogs) Message size is 156 >Thread-14::DEBUG::2014-09-04 21:01:43,135::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:01:43,135::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:01:43,135::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:01:43,136::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:01:43,136::__init__::225::IOProcess::(_processLogs) (844034) Finding callback 'touch'... >Thread-14::DEBUG::2014-09-04 21:01:43,136::__init__::225::IOProcess::(_processLogs) (844034) Got request for method 'touch' >Thread-14::DEBUG::2014-09-04 21:01:43,136::__init__::225::IOProcess::(_processLogs) (844034) Queuing response >Thread-14::DEBUG::2014-09-04 21:01:43,136::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-10379::DEBUG::2014-09-04 21:01:43,137::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-14::DEBUG::2014-09-04 21:01:43,137::__init__::225::IOProcess::(_processLogs) Message size is 180 >Thread-14::DEBUG::2014-09-04 21:01:43,138::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:01:43,138::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:01:43,138::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:01:43,138::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:01:43,138::__init__::225::IOProcess::(_processLogs) (844035) Finding callback 'readfile'... >Thread-14::DEBUG::2014-09-04 21:01:43,138::__init__::225::IOProcess::(_processLogs) (844035) Got request for method 'readfile' >Thread-14::DEBUG::2014-09-04 21:01:43,138::__init__::225::IOProcess::(_processLogs) (844035) Queuing response >Thread-14::DEBUG::2014-09-04 21:01:43,138::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:01:43,139::__init__::225::IOProcess::(_processLogs) Sending response sized 526 >Thread-10379::DEBUG::2014-09-04 21:01:43,139::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Backup', 'DESCRIPTION=Expot_Meital', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'POOL_UUID=78390355-2a2d-41e5-aea5-fb426559f747', 'REMOTE_PATH=10.35.160.108:/RHEV/mavital', 'ROLE=Regular', 'SDUUID=7ad04229-b793-4f73-ad10-5e41a4e836ff', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=6ec5365594bb9afd664a6fe429d1776f3104e6f5'] >Thread-14::DEBUG::2014-09-04 21:01:43,140::__init__::225::IOProcess::(_processLogs) Message size is 173 >Thread-14::DEBUG::2014-09-04 21:01:43,140::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:01:43,140::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:01:43,140::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:01:43,140::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:01:43,140::__init__::225::IOProcess::(_processLogs) (844036) Finding callback 'access'... >Thread-14::DEBUG::2014-09-04 21:01:43,140::__init__::225::IOProcess::(_processLogs) (844036) Got request for method 'access' >Thread-14::DEBUG::2014-09-04 21:01:43,140::__init__::225::IOProcess::(_processLogs) (844036) Building response >Thread-14::DEBUG::2014-09-04 21:01:43,141::__init__::225::IOProcess::(_processLogs) (844036) Queuing response >Thread-14::DEBUG::2014-09-04 21:01:43,141::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:01:43,141::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-14::DEBUG::2014-09-04 21:01:43,142::__init__::225::IOProcess::(_processLogs) Message size is 167 >Thread-14::DEBUG::2014-09-04 21:01:43,145::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:01:43,148::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:01:43,148::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:01:43,148::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:01:43,148::__init__::225::IOProcess::(_processLogs) (844037) Finding callback 'glob'... >Thread-14::DEBUG::2014-09-04 21:01:43,149::__init__::225::IOProcess::(_processLogs) (844037) Got request for method 'glob' >Thread-14::DEBUG::2014-09-04 21:01:43,149::__init__::225::IOProcess::(_processLogs) (844037) Building response >Thread-14::DEBUG::2014-09-04 21:01:43,149::__init__::225::IOProcess::(_processLogs) (844037) Queuing response >Thread-14::DEBUG::2014-09-04 21:01:43,149::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:01:43,149::__init__::225::IOProcess::(_processLogs) Sending response sized 78 >Thread-10379::DEBUG::2014-09-04 21:01:43,149::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-10379::INFO::2014-09-04 21:01:43,150::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 7ad04229-b793-4f73-ad10-5e41a4e836ff_imageNS already registered >Thread-10379::INFO::2014-09-04 21:01:43,150::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 7ad04229-b793-4f73-ad10-5e41a4e836ff_volumeNS already registered >Thread-14::DEBUG::2014-09-04 21:01:43,150::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-14::DEBUG::2014-09-04 21:01:43,150::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:01:43,150::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:01:43,151::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:01:43,151::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:01:43,151::__init__::225::IOProcess::(_processLogs) (844038) Finding callback 'statvfs'... >Thread-14::DEBUG::2014-09-04 21:01:43,151::__init__::225::IOProcess::(_processLogs) (844038) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-04 21:01:43,151::__init__::225::IOProcess::(_processLogs) (844038) Queuing response >Thread-14::DEBUG::2014-09-04 21:01:43,151::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:01:43,151::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-10379::DEBUG::2014-09-04 21:01:43,152::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mavital/7ad04229-b793-4f73-ad10-5e41a4e836ff/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-10379::DEBUG::2014-09-04 21:01:43,481::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n339 bytes (339 B) copied, 0.000336981 s, 1.0 MB/s\n'; <rc> = 0 >Thread-14054::DEBUG::2014-09-04 21:01:43,482::BindingXMLRPC::318::vds::(wrapper) client [10.35.163.104] flowID [44e575f1] >Thread-14054::DEBUG::2014-09-04 21:01:43,487::task::595::Storage.TaskManager.Task::(_updateState) Task=`b66a8b90-b440-4e3d-972f-58bab68e65ae`::moving from state init -> state preparing >Thread-14::DEBUG::2014-09-04 21:01:43,488::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-14054::INFO::2014-09-04 21:01:43,489::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='78390355-2a2d-41e5-aea5-fb426559f747', options=None) >Thread-14::DEBUG::2014-09-04 21:01:43,490::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:01:43,491::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-04 21:01:43,491::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:01:43,491::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:01:43,491::__init__::225::IOProcess::(_processLogs) (844039) Finding callback 'statvfs'... >Thread-14::DEBUG::2014-09-04 21:01:43,491::__init__::225::IOProcess::(_processLogs) (844039) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-04 21:01:43,492::__init__::225::IOProcess::(_processLogs) (844039) Building response >Thread-14::DEBUG::2014-09-04 21:01:43,492::__init__::225::IOProcess::(_processLogs) (844039) Queuing response >Thread-14::DEBUG::2014-09-04 21:01:43,492::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:01:43,492::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-14054::INFO::2014-09-04 21:01:43,502::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 8L}} >Thread-14054::DEBUG::2014-09-04 21:01:43,503::task::1191::Storage.TaskManager.Task::(prepare) Task=`b66a8b90-b440-4e3d-972f-58bab68e65ae`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 8L}} >Thread-14054::DEBUG::2014-09-04 21:01:43,503::task::595::Storage.TaskManager.Task::(_updateState) Task=`b66a8b90-b440-4e3d-972f-58bab68e65ae`::moving from state preparing -> state finished >Thread-14054::DEBUG::2014-09-04 21:01:43,503::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14054::DEBUG::2014-09-04 21:01:43,503::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14054::DEBUG::2014-09-04 21:01:43,503::task::993::Storage.TaskManager.Task::(_decref) Task=`b66a8b90-b440-4e3d-972f-58bab68e65ae`::ref 0 aborting False >Thread-43::DEBUG::2014-09-04 21:01:43,517::BindingXMLRPC::318::vds::(wrapper) client [10.35.163.104] flowID [44e575f1] >Thread-43::DEBUG::2014-09-04 21:01:43,518::task::595::Storage.TaskManager.Task::(_updateState) Task=`4c0c7a7e-6c66-4376-8f62-d40dc25a2dc4`::moving from state init -> state preparing >Thread-43::INFO::2014-09-04 21:01:43,518::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='78390355-2a2d-41e5-aea5-fb426559f747', options=None) >Thread-43::DEBUG::2014-09-04 21:01:43,519::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.78390355-2a2d-41e5-aea5-fb426559f747`ReqID=`ace35b20-eafd-4e5f-ae3f-14196a391a9d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-43::DEBUG::2014-09-04 21:01:43,519::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.78390355-2a2d-41e5-aea5-fb426559f747' for lock type 'shared' >Thread-43::DEBUG::2014-09-04 21:01:43,519::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.78390355-2a2d-41e5-aea5-fb426559f747' is free. Now locking as 'shared' (1 active user) >Thread-43::DEBUG::2014-09-04 21:01:43,519::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.78390355-2a2d-41e5-aea5-fb426559f747`ReqID=`ace35b20-eafd-4e5f-ae3f-14196a391a9d`::Granted request >Thread-43::DEBUG::2014-09-04 21:01:43,519::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`4c0c7a7e-6c66-4376-8f62-d40dc25a2dc4`::_resourcesAcquired: Storage.78390355-2a2d-41e5-aea5-fb426559f747 (shared) >Thread-43::DEBUG::2014-09-04 21:01:43,519::task::993::Storage.TaskManager.Task::(_decref) Task=`4c0c7a7e-6c66-4376-8f62-d40dc25a2dc4`::ref 1 aborting False >Thread-43::INFO::2014-09-04 21:01:43,534::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': u'/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_qa_shared__iso__domain/7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 8L, 'domains': '180c43ee-5baf-41b7-87c7-c0214b51fe8f:Active,7ad04229-b793-4f73-ad10-5e41a4e836ff:Active,7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6:Active', 'master_uuid': u'180c43ee-5baf-41b7-87c7-c0214b51fe8f', 'version': '3', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'180c43ee-5baf-41b7-87c7-c0214b51fe8f': {'status': 'Active', 'diskfree': '1820606595072', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246104576', 'version': 3}, '7ad04229-b793-4f73-ad10-5e41a4e836ff': {'status': 'Active', 'diskfree': '1820606595072', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246104576', 'version': 0}, '7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6': {'status': 'Active', 'diskfree': '18881708032', 'isoprefix': u'/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_qa_shared__iso__domain/7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '652611682304', 'version': 0}}} >Thread-43::DEBUG::2014-09-04 21:01:43,534::task::1191::Storage.TaskManager.Task::(prepare) Task=`4c0c7a7e-6c66-4376-8f62-d40dc25a2dc4`::finished: {'info': {'name': 'No Description', 'isoprefix': u'/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_qa_shared__iso__domain/7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 8L, 'domains': '180c43ee-5baf-41b7-87c7-c0214b51fe8f:Active,7ad04229-b793-4f73-ad10-5e41a4e836ff:Active,7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6:Active', 'master_uuid': u'180c43ee-5baf-41b7-87c7-c0214b51fe8f', 'version': '3', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'180c43ee-5baf-41b7-87c7-c0214b51fe8f': {'status': 'Active', 'diskfree': '1820606595072', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246104576', 'version': 3}, '7ad04229-b793-4f73-ad10-5e41a4e836ff': {'status': 'Active', 'diskfree': '1820606595072', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246104576', 'version': 0}, '7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6': {'status': 'Active', 'diskfree': '18881708032', 'isoprefix': u'/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_qa_shared__iso__domain/7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '652611682304', 'version': 0}}} >Thread-43::DEBUG::2014-09-04 21:01:43,534::task::595::Storage.TaskManager.Task::(_updateState) Task=`4c0c7a7e-6c66-4376-8f62-d40dc25a2dc4`::moving from state preparing -> state finished >Thread-43::DEBUG::2014-09-04 21:01:43,534::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.78390355-2a2d-41e5-aea5-fb426559f747': < ResourceRef 'Storage.78390355-2a2d-41e5-aea5-fb426559f747', isValid: 'True' obj: 'None'>} >Thread-43::DEBUG::2014-09-04 21:01:43,535::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-43::DEBUG::2014-09-04 21:01:43,535::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.78390355-2a2d-41e5-aea5-fb426559f747' >Thread-43::DEBUG::2014-09-04 21:01:43,535::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.78390355-2a2d-41e5-aea5-fb426559f747' (0 active users) >Thread-43::DEBUG::2014-09-04 21:01:43,535::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.78390355-2a2d-41e5-aea5-fb426559f747' is free, finding out if anyone is waiting for it. >Thread-43::DEBUG::2014-09-04 21:01:43,535::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.78390355-2a2d-41e5-aea5-fb426559f747', Clearing records. >Thread-43::DEBUG::2014-09-04 21:01:43,535::task::993::Storage.TaskManager.Task::(_decref) Task=`4c0c7a7e-6c66-4376-8f62-d40dc25a2dc4`::ref 0 aborting False >Dummy-41::DEBUG::2014-09-04 21:01:43,720::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/78390355-2a2d-41e5-aea5-fb426559f747/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-41::DEBUG::2014-09-04 21:01:44,084::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0126939 s, 80.7 MB/s\n'; <rc> = 0 >Dummy-41::DEBUG::2014-09-04 21:01:46,172::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/78390355-2a2d-41e5-aea5-fb426559f747/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-41::DEBUG::2014-09-04 21:01:46,779::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.223785 s, 4.6 MB/s\n'; <rc> = 0 >GuestMonitor-numa__test::DEBUG::2014-09-04 21:01:47,690::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >GuestMonitor-numa__test::DEBUG::2014-09-04 21:01:47,692::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >GuestMonitor-numa__test::DEBUG::2014-09-04 21:01:47,693::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >GuestMonitor-quota__vm::DEBUG::2014-09-04 21:01:47,695::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >GuestMonitor-quota__vm::DEBUG::2014-09-04 21:01:47,697::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >GuestMonitor-quota__vm::DEBUG::2014-09-04 21:01:47,698::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >Dummy-41::DEBUG::2014-09-04 21:01:48,793::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/78390355-2a2d-41e5-aea5-fb426559f747/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-41::DEBUG::2014-09-04 21:01:49,178::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0127372 s, 80.4 MB/s\n'; <rc> = 0 >Dummy-41::DEBUG::2014-09-04 21:01:51,191::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/78390355-2a2d-41e5-aea5-fb426559f747/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-41::DEBUG::2014-09-04 21:01:51,571::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0136823 s, 74.8 MB/s\n'; <rc> = 0 >Thread-14054::DEBUG::2014-09-04 21:01:51,683::task::595::Storage.TaskManager.Task::(_updateState) Task=`77bb1496-902e-461c-a688-c6e0494b795c`::moving from state init -> state preparing >Thread-14054::INFO::2014-09-04 21:01:51,684::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14054::INFO::2014-09-04 21:01:51,684::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180c43ee-5baf-41b7-87c7-c0214b51fe8f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000366957', 'lastCheck': '8.9', 'valid': True}, '7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000935353', 'lastCheck': '9.0', 'valid': True}, '7ad04229-b793-4f73-ad10-5e41a4e836ff': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000336981', 'lastCheck': '8.2', 'valid': True}} >Thread-14054::DEBUG::2014-09-04 21:01:51,684::task::1191::Storage.TaskManager.Task::(prepare) Task=`77bb1496-902e-461c-a688-c6e0494b795c`::finished: {'180c43ee-5baf-41b7-87c7-c0214b51fe8f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000366957', 'lastCheck': '8.9', 'valid': True}, '7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000935353', 'lastCheck': '9.0', 'valid': True}, '7ad04229-b793-4f73-ad10-5e41a4e836ff': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000336981', 'lastCheck': '8.2', 'valid': True}} >Thread-14054::DEBUG::2014-09-04 21:01:51,684::task::595::Storage.TaskManager.Task::(_updateState) Task=`77bb1496-902e-461c-a688-c6e0494b795c`::moving from state preparing -> state finished >Thread-14054::DEBUG::2014-09-04 21:01:51,684::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14054::DEBUG::2014-09-04 21:01:51,684::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14054::DEBUG::2014-09-04 21:01:51,685::task::993::Storage.TaskManager.Task::(_decref) Task=`77bb1496-902e-461c-a688-c6e0494b795c`::ref 0 aborting False >Thread-14054::DEBUG::2014-09-04 21:01:51,707::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >Thread-14054::DEBUG::2014-09-04 21:01:51,707::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >Thread-14::DEBUG::2014-09-04 21:01:52,689::__init__::225::IOProcess::(_processLogs) Message size is 190 >Thread-14::DEBUG::2014-09-04 21:01:52,690::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:01:52,690::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-04 21:01:52,690::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:01:52,690::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:01:52,690::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-14::DEBUG::2014-09-04 21:01:52,691::__init__::225::IOProcess::(_processLogs) (844040) Finding callback 'statvfs'... >Thread-14::DEBUG::2014-09-04 21:01:52,691::__init__::225::IOProcess::(_processLogs) (844040) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-04 21:01:52,691::__init__::225::IOProcess::(_processLogs) DEBUG|(844040) Building response >Thread-14::DEBUG::2014-09-04 21:01:52,691::__init__::225::IOProcess::(_processLogs) (844040) Queuing response >Thread-14::DEBUG::2014-09-04 21:01:52,691::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:01:52,691::__init__::225::IOProcess::(_processLogs) Sending response sized 329 >Thread-18::DEBUG::2014-09-04 21:01:52,692::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_qa_shared__iso__domain/7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-14::DEBUG::2014-09-04 21:01:53,022::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-09-04 21:01:53,024::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1581 bytes (1.6 kB) copied, 0.00077432 s, 2.0 MB/s\n'; <rc> = 0 >GuestMonitor-quota__vm::DEBUG::2014-09-04 21:01:53,026::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >GuestMonitor-numa__test::DEBUG::2014-09-04 21:01:53,027::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >Thread-14::DEBUG::2014-09-04 21:01:53,031::__init__::225::IOProcess::(_processLogs) Message size is 166 >Thread-14::DEBUG::2014-09-04 21:01:53,037::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:01:53,044::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-04 21:01:53,051::__init__::225::IOProcess::(_processLogs) Waiting for next request... >GuestMonitor-quota__vm::DEBUG::2014-09-04 21:01:53,054::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >GuestMonitor-numa__test::DEBUG::2014-09-04 21:01:53,055::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >Thread-14::DEBUG::2014-09-04 21:01:53,057::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:01:53,063::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:01:53,069::__init__::225::IOProcess::(_processLogs) (844041) Finding callback 'statvfs'... >Thread-14::DEBUG::2014-09-04 21:01:53,076::__init__::225::IOProcess::(_processLogs) (844041) Got request for method 'statvfs' >GuestMonitor-numa__test::DEBUG::2014-09-04 21:01:53,081::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >GuestMonitor-quota__vm::DEBUG::2014-09-04 21:01:53,081::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >Thread-14::DEBUG::2014-09-04 21:01:53,083::__init__::225::IOProcess::(_processLogs) DEBUG|(844041) Building response >Thread-14::DEBUG::2014-09-04 21:01:53,090::__init__::225::IOProcess::(_processLogs) (844041) Queuing response >Thread-14::DEBUG::2014-09-04 21:01:53,096::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:01:53,101::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-14::DEBUG::2014-09-04 21:01:53,110::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-17::DEBUG::2014-09-04 21:01:53,110::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_artyom__storage__rhevm__35/180c43ee-5baf-41b7-87c7-c0214b51fe8f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-14::DEBUG::2014-09-04 21:01:53,425::__init__::225::IOProcess::(_processLogs) Message size is 190 >Thread-14::DEBUG::2014-09-04 21:01:53,429::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:01:53,432::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-17::DEBUG::2014-09-04 21:01:53,433::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n474 bytes (474 B) copied, 0.000347471 s, 1.4 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-04 21:01:53,435::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:01:53,438::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:01:53,439::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:01:53,441::__init__::225::IOProcess::(_processLogs) (844042) Finding callback 'statvfs'... >Thread-14::DEBUG::2014-09-04 21:01:53,441::__init__::225::IOProcess::(_processLogs) (844042) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-04 21:01:53,443::__init__::225::IOProcess::(_processLogs) DEBUG|(844042) Building response >Thread-14::DEBUG::2014-09-04 21:01:53,444::__init__::225::IOProcess::(_processLogs) (844042) Queuing response >Thread-14::DEBUG::2014-09-04 21:01:53,445::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:01:53,446::__init__::225::IOProcess::(_processLogs) Sending response sized 329 >Thread-14::DEBUG::2014-09-04 21:01:53,453::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-14::DEBUG::2014-09-04 21:01:53,456::__init__::225::IOProcess::(_processLogs) Message size is 166 >Thread-14::DEBUG::2014-09-04 21:01:53,457::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:01:53,458::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-04 21:01:53,460::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:01:53,461::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:01:53,462::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:01:53,463::__init__::225::IOProcess::(_processLogs) (844043) Finding callback 'statvfs'... >Thread-14::DEBUG::2014-09-04 21:01:53,464::__init__::225::IOProcess::(_processLogs) (844043) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-04 21:01:53,465::__init__::225::IOProcess::(_processLogs) (844043) Building response >Thread-14::DEBUG::2014-09-04 21:01:53,466::__init__::225::IOProcess::(_processLogs) (844043) Queuing response >Thread-14::DEBUG::2014-09-04 21:01:53,468::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:01:53,469::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-14::DEBUG::2014-09-04 21:01:53,474::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-14::DEBUG::2014-09-04 21:01:53,475::__init__::225::IOProcess::(_processLogs) Message size is 183 >Thread-14::DEBUG::2014-09-04 21:01:53,475::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:01:53,475::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-14::DEBUG::2014-09-04 21:01:53,475::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:01:53,476::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:01:53,477::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:01:53,478::__init__::225::IOProcess::(_processLogs) (844044) Finding callback 'access'... >Thread-14::DEBUG::2014-09-04 21:01:53,479::__init__::225::IOProcess::(_processLogs) (844044) Got request for method 'access' >Thread-14::DEBUG::2014-09-04 21:01:53,479::__init__::225::IOProcess::(_processLogs) (844044) Building response >Thread-14::DEBUG::2014-09-04 21:01:53,480::__init__::225::IOProcess::(_processLogs) (844044) Queuing response >Thread-14::DEBUG::2014-09-04 21:01:53,481::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:01:53,482::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-14::DEBUG::2014-09-04 21:01:53,485::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-14::DEBUG::2014-09-04 21:01:53,486::__init__::225::IOProcess::(_processLogs) Message size is 187 >Thread-14::DEBUG::2014-09-04 21:01:53,486::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:01:53,487::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-04 21:01:53,488::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:01:53,489::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:01:53,490::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:01:53,490::__init__::225::IOProcess::(_processLogs) (844045) Finding callback 'access'... >Thread-14::DEBUG::2014-09-04 21:01:53,491::__init__::225::IOProcess::(_processLogs) (844045) Got request for method 'access' >Thread-14::DEBUG::2014-09-04 21:01:53,492::__init__::225::IOProcess::(_processLogs) (844045) Building response >Thread-14::DEBUG::2014-09-04 21:01:53,493::__init__::225::IOProcess::(_processLogs) (844045) Queuing response >Thread-14::DEBUG::2014-09-04 21:01:53,495::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:01:53,496::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-14::DEBUG::2014-09-04 21:01:53,501::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-14::DEBUG::2014-09-04 21:01:53,502::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-14::DEBUG::2014-09-04 21:01:53,503::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:01:53,503::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-04 21:01:53,504::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:01:53,505::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:01:53,506::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:01:53,507::__init__::225::IOProcess::(_processLogs) (844046) Finding callback 'statvfs'... >Thread-14::DEBUG::2014-09-04 21:01:53,508::__init__::225::IOProcess::(_processLogs) (844046) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-04 21:01:53,509::__init__::225::IOProcess::(_processLogs) DEBUG|(844046) Building response >Thread-14::DEBUG::2014-09-04 21:01:53,510::__init__::225::IOProcess::(_processLogs) (844046) Queuing response >Thread-14::DEBUG::2014-09-04 21:01:53,510::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:01:53,511::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-14::DEBUG::2014-09-04 21:01:53,516::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-10379::DEBUG::2014-09-04 21:01:53,518::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mavital/7ad04229-b793-4f73-ad10-5e41a4e836ff/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-14::DEBUG::2014-09-04 21:01:53,519::__init__::225::IOProcess::(_processLogs) Message size is 189 >Thread-14::DEBUG::2014-09-04 21:01:53,857::__init__::225::IOProcess::(_processLogs) Marshaling message... >Dummy-41::DEBUG::2014-09-04 21:01:53,862::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/78390355-2a2d-41e5-aea5-fb426559f747/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-14054::DEBUG::2014-09-04 21:01:53,867::BindingXMLRPC::318::vds::(wrapper) client [10.35.163.104] flowID [15cf83df] >Thread-10379::DEBUG::2014-09-04 21:01:53,868::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n339 bytes (339 B) copied, 0.000343166 s, 988 kB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-04 21:01:53,868::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14054::DEBUG::2014-09-04 21:01:54,207::task::595::Storage.TaskManager.Task::(_updateState) Task=`f5a16122-e85f-45ed-a417-4163108a343c`::moving from state init -> state preparing >Thread-14::DEBUG::2014-09-04 21:01:54,207::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14054::INFO::2014-09-04 21:01:54,211::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='78390355-2a2d-41e5-aea5-fb426559f747', options=None) >Thread-14::DEBUG::2014-09-04 21:01:54,212::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:01:54,216::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:01:54,220::__init__::225::IOProcess::(_processLogs) (844047) Finding callback 'access'... >Thread-14::DEBUG::2014-09-04 21:01:54,223::__init__::225::IOProcess::(_processLogs) (844047) Got request for method 'access' >Thread-14::DEBUG::2014-09-04 21:01:54,226::__init__::225::IOProcess::(_processLogs) (844047) Building response >Thread-14054::INFO::2014-09-04 21:01:54,228::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 8L}} >Thread-14::DEBUG::2014-09-04 21:01:54,230::__init__::225::IOProcess::(_processLogs) (844047) Queuing response >Thread-14054::DEBUG::2014-09-04 21:01:54,232::task::1191::Storage.TaskManager.Task::(prepare) Task=`f5a16122-e85f-45ed-a417-4163108a343c`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 8L}} >Thread-14::DEBUG::2014-09-04 21:01:54,234::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14054::DEBUG::2014-09-04 21:01:54,235::task::595::Storage.TaskManager.Task::(_updateState) Task=`f5a16122-e85f-45ed-a417-4163108a343c`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-09-04 21:01:54,239::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 76 >Thread-14054::DEBUG::2014-09-04 21:01:54,239::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14054::DEBUG::2014-09-04 21:01:54,243::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14054::DEBUG::2014-09-04 21:01:54,248::task::993::Storage.TaskManager.Task::(_decref) Task=`f5a16122-e85f-45ed-a417-4163108a343c`::ref 0 aborting False >Thread-14::DEBUG::2014-09-04 21:01:54,251::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-14::DEBUG::2014-09-04 21:01:54,257::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-14::DEBUG::2014-09-04 21:01:54,262::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:01:54,266::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-04 21:01:54,268::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:01:54,271::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:01:54,274::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:01:54,278::__init__::225::IOProcess::(_processLogs) (844048) Finding callback 'statvfs'... >Thread-14::DEBUG::2014-09-04 21:01:54,283::__init__::225::IOProcess::(_processLogs) (844048) Got request for method 'statvfs' >Thread-43::DEBUG::2014-09-04 21:01:54,283::BindingXMLRPC::318::vds::(wrapper) client [10.35.163.104] flowID [15cf83df] >Thread-14::DEBUG::2014-09-04 21:01:54,288::__init__::225::IOProcess::(_processLogs) DEBUG|(844048) Building response >Thread-43::DEBUG::2014-09-04 21:01:54,325::task::595::Storage.TaskManager.Task::(_updateState) Task=`a0ea0ea9-c046-4975-b5b7-3ada667fa14d`::moving from state init -> state preparing >Thread-14::DEBUG::2014-09-04 21:01:54,326::__init__::225::IOProcess::(_processLogs) (844048) Queuing response >Dummy-41::DEBUG::2014-09-04 21:01:54,328::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0880821 s, 11.6 MB/s\n'; <rc> = 0 >Thread-43::INFO::2014-09-04 21:01:54,330::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='78390355-2a2d-41e5-aea5-fb426559f747', options=None) >Thread-14::DEBUG::2014-09-04 21:01:54,331::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:01:54,336::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-43::DEBUG::2014-09-04 21:01:54,342::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.78390355-2a2d-41e5-aea5-fb426559f747`ReqID=`517987c7-d96a-4899-85db-e537cfff331c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-43::DEBUG::2014-09-04 21:01:54,346::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.78390355-2a2d-41e5-aea5-fb426559f747' for lock type 'shared' >Thread-43::DEBUG::2014-09-04 21:01:54,353::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.78390355-2a2d-41e5-aea5-fb426559f747' is free. Now locking as 'shared' (1 active user) >Thread-43::DEBUG::2014-09-04 21:01:54,357::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.78390355-2a2d-41e5-aea5-fb426559f747`ReqID=`517987c7-d96a-4899-85db-e537cfff331c`::Granted request >Thread-43::DEBUG::2014-09-04 21:01:54,364::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`a0ea0ea9-c046-4975-b5b7-3ada667fa14d`::_resourcesAcquired: Storage.78390355-2a2d-41e5-aea5-fb426559f747 (shared) >Thread-43::DEBUG::2014-09-04 21:01:54,367::task::993::Storage.TaskManager.Task::(_decref) Task=`a0ea0ea9-c046-4975-b5b7-3ada667fa14d`::ref 1 aborting False >Thread-43::INFO::2014-09-04 21:01:54,447::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': u'/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_qa_shared__iso__domain/7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 8L, 'domains': '180c43ee-5baf-41b7-87c7-c0214b51fe8f:Active,7ad04229-b793-4f73-ad10-5e41a4e836ff:Active,7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6:Active', 'master_uuid': u'180c43ee-5baf-41b7-87c7-c0214b51fe8f', 'version': '3', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'180c43ee-5baf-41b7-87c7-c0214b51fe8f': {'status': 'Active', 'diskfree': '1820606660608', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246104576', 'version': 3}, '7ad04229-b793-4f73-ad10-5e41a4e836ff': {'status': 'Active', 'diskfree': '1820606660608', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246104576', 'version': 0}, '7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6': {'status': 'Active', 'diskfree': '18881708032', 'isoprefix': u'/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_qa_shared__iso__domain/7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '652611682304', 'version': 0}}} >Thread-43::DEBUG::2014-09-04 21:01:54,450::task::1191::Storage.TaskManager.Task::(prepare) Task=`a0ea0ea9-c046-4975-b5b7-3ada667fa14d`::finished: {'info': {'name': 'No Description', 'isoprefix': u'/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_qa_shared__iso__domain/7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 8L, 'domains': '180c43ee-5baf-41b7-87c7-c0214b51fe8f:Active,7ad04229-b793-4f73-ad10-5e41a4e836ff:Active,7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6:Active', 'master_uuid': u'180c43ee-5baf-41b7-87c7-c0214b51fe8f', 'version': '3', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'180c43ee-5baf-41b7-87c7-c0214b51fe8f': {'status': 'Active', 'diskfree': '1820606660608', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246104576', 'version': 3}, '7ad04229-b793-4f73-ad10-5e41a4e836ff': {'status': 'Active', 'diskfree': '1820606660608', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246104576', 'version': 0}, '7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6': {'status': 'Active', 'diskfree': '18881708032', 'isoprefix': u'/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_qa_shared__iso__domain/7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '652611682304', 'version': 0}}} >Thread-43::DEBUG::2014-09-04 21:01:54,452::task::595::Storage.TaskManager.Task::(_updateState) Task=`a0ea0ea9-c046-4975-b5b7-3ada667fa14d`::moving from state preparing -> state finished >Thread-43::DEBUG::2014-09-04 21:01:54,454::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.78390355-2a2d-41e5-aea5-fb426559f747': < ResourceRef 'Storage.78390355-2a2d-41e5-aea5-fb426559f747', isValid: 'True' obj: 'None'>} >Thread-43::DEBUG::2014-09-04 21:01:54,456::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-43::DEBUG::2014-09-04 21:01:54,459::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.78390355-2a2d-41e5-aea5-fb426559f747' >Thread-43::DEBUG::2014-09-04 21:01:54,461::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.78390355-2a2d-41e5-aea5-fb426559f747' (0 active users) >Thread-43::DEBUG::2014-09-04 21:01:54,463::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.78390355-2a2d-41e5-aea5-fb426559f747' is free, finding out if anyone is waiting for it. >Thread-43::DEBUG::2014-09-04 21:01:54,464::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.78390355-2a2d-41e5-aea5-fb426559f747', Clearing records. >Thread-43::DEBUG::2014-09-04 21:01:54,468::task::993::Storage.TaskManager.Task::(_decref) Task=`a0ea0ea9-c046-4975-b5b7-3ada667fa14d`::ref 0 aborting False >Dummy-41::DEBUG::2014-09-04 21:01:56,676::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/78390355-2a2d-41e5-aea5-fb426559f747/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-41::DEBUG::2014-09-04 21:01:57,040::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0123876 s, 82.7 MB/s\n'; <rc> = 0 >GuestMonitor-numa__test::DEBUG::2014-09-04 21:01:58,104::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >GuestMonitor-numa__test::DEBUG::2014-09-04 21:01:58,105::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >GuestMonitor-numa__test::DEBUG::2014-09-04 21:01:58,106::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >GuestMonitor-quota__vm::DEBUG::2014-09-04 21:01:58,108::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >GuestMonitor-quota__vm::DEBUG::2014-09-04 21:01:58,109::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >GuestMonitor-quota__vm::DEBUG::2014-09-04 21:01:58,110::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >Dummy-41::DEBUG::2014-09-04 21:01:59,062::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/78390355-2a2d-41e5-aea5-fb426559f747/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-41::DEBUG::2014-09-04 21:01:59,423::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0131292 s, 78.0 MB/s\n'; <rc> = 0 >Dummy-41::DEBUG::2014-09-04 21:02:01,443::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/78390355-2a2d-41e5-aea5-fb426559f747/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-41::DEBUG::2014-09-04 21:02:01,802::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0126742 s, 80.8 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-09-04 21:02:02,385::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-09-04 21:02:02,385::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 57. >GuestMonitor-numa__test::DEBUG::2014-09-04 21:02:03,113::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >GuestMonitor-quota__vm::DEBUG::2014-09-04 21:02:03,116::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >GuestMonitor-numa__test::DEBUG::2014-09-04 21:02:03,118::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >GuestMonitor-quota__vm::DEBUG::2014-09-04 21:02:03,121::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >GuestMonitor-numa__test::DEBUG::2014-09-04 21:02:03,123::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >GuestMonitor-quota__vm::DEBUG::2014-09-04 21:02:03,126::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >Thread-14::DEBUG::2014-09-04 21:02:03,458::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-14::DEBUG::2014-09-04 21:02:03,458::__init__::225::IOProcess::(_processLogs) Message size is 190 >Thread-14::DEBUG::2014-09-04 21:02:03,459::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:02:03,459::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-04 21:02:03,459::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:02:03,459::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:02:03,459::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-14::DEBUG::2014-09-04 21:02:03,459::__init__::225::IOProcess::(_processLogs) (844049) Finding callback 'statvfs'... >Thread-14::DEBUG::2014-09-04 21:02:03,459::__init__::225::IOProcess::(_processLogs) (844049) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-04 21:02:03,459::__init__::225::IOProcess::(_processLogs) (844049) Building response >Thread-14::DEBUG::2014-09-04 21:02:03,460::__init__::225::IOProcess::(_processLogs) (844049) Queuing response >Thread-14::DEBUG::2014-09-04 21:02:03,460::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:02:03,460::__init__::225::IOProcess::(_processLogs) Sending response sized 329 >Thread-18::DEBUG::2014-09-04 21:02:03,461::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_qa_shared__iso__domain/7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Dummy-41::DEBUG::2014-09-04 21:02:04,313::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/78390355-2a2d-41e5-aea5-fb426559f747/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-18::DEBUG::2014-09-04 21:02:04,314::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1618 bytes (1.6 kB) copied, 0.000608691 s, 2.7 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-04 21:02:04,988::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-14::DEBUG::2014-09-04 21:02:05,001::__init__::225::IOProcess::(_processLogs) Message size is 166 >Thread-13916::DEBUG::2014-09-04 21:02:05,004::BindingXMLRPC::318::vds::(wrapper) client [10.35.163.104] flowID [3aa28d6a] >Thread-14::DEBUG::2014-09-04 21:02:05,008::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-13916::DEBUG::2014-09-04 21:02:05,014::task::595::Storage.TaskManager.Task::(_updateState) Task=`17436e06-7831-492c-a52d-e12953652f33`::moving from state init -> state preparing >Thread-14::DEBUG::2014-09-04 21:02:05,015::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-13916::INFO::2014-09-04 21:02:05,019::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='78390355-2a2d-41e5-aea5-fb426559f747', options=None) >Thread-14::DEBUG::2014-09-04 21:02:05,020::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:02:05,024::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:02:05,027::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:02:05,030::__init__::225::IOProcess::(_processLogs) (844050) Finding callback 'statvfs'... >Thread-14::DEBUG::2014-09-04 21:02:05,032::__init__::225::IOProcess::(_processLogs) (844050) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-04 21:02:05,034::__init__::225::IOProcess::(_processLogs) (844050) Building response >Thread-13916::INFO::2014-09-04 21:02:05,035::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 8L}} >Thread-14::DEBUG::2014-09-04 21:02:05,037::__init__::225::IOProcess::(_processLogs) (844050) Queuing response >Thread-13916::DEBUG::2014-09-04 21:02:05,039::task::1191::Storage.TaskManager.Task::(prepare) Task=`17436e06-7831-492c-a52d-e12953652f33`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 8L}} >Thread-14::DEBUG::2014-09-04 21:02:05,041::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-13916::DEBUG::2014-09-04 21:02:05,042::task::595::Storage.TaskManager.Task::(_updateState) Task=`17436e06-7831-492c-a52d-e12953652f33`::moving from state preparing -> state finished >Thread-13916::DEBUG::2014-09-04 21:02:05,045::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-09-04 21:02:05,045::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-13916::DEBUG::2014-09-04 21:02:05,048::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13916::DEBUG::2014-09-04 21:02:05,053::task::993::Storage.TaskManager.Task::(_decref) Task=`17436e06-7831-492c-a52d-e12953652f33`::ref 0 aborting False >Thread-14::DEBUG::2014-09-04 21:02:05,064::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-17::DEBUG::2014-09-04 21:02:05,068::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_artyom__storage__rhevm__35/180c43ee-5baf-41b7-87c7-c0214b51fe8f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-14::DEBUG::2014-09-04 21:02:05,069::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-14::DEBUG::2014-09-04 21:02:05,439::__init__::225::IOProcess::(_processLogs) Marshaling message... >Dummy-41::DEBUG::2014-09-04 21:02:05,444::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0826182 s, 12.4 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-04 21:02:05,448::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-17::DEBUG::2014-09-04 21:02:05,448::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n474 bytes (474 B) copied, 0.000403066 s, 1.2 MB/s\n'; <rc> = 0 >Thread-43::DEBUG::2014-09-04 21:02:05,451::BindingXMLRPC::318::vds::(wrapper) client [10.35.163.104] flowID [3aa28d6a] >Thread-14::DEBUG::2014-09-04 21:02:05,456::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:02:05,463::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-43::DEBUG::2014-09-04 21:02:05,464::task::595::Storage.TaskManager.Task::(_updateState) Task=`dce4f17a-6cbb-4d25-89e7-969807845ab7`::moving from state init -> state preparing >Thread-14::DEBUG::2014-09-04 21:02:05,469::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-43::INFO::2014-09-04 21:02:05,470::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='78390355-2a2d-41e5-aea5-fb426559f747', options=None) >Thread-14::DEBUG::2014-09-04 21:02:05,475::__init__::225::IOProcess::(_processLogs) (844051) Finding callback 'statvfs'... >Thread-14::DEBUG::2014-09-04 21:02:05,481::__init__::225::IOProcess::(_processLogs) (844051) Got request for method 'statvfs' >Thread-43::DEBUG::2014-09-04 21:02:05,485::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.78390355-2a2d-41e5-aea5-fb426559f747`ReqID=`c5241185-25a0-4154-b3ab-eedf7c4bbe5c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-14::DEBUG::2014-09-04 21:02:05,488::__init__::225::IOProcess::(_processLogs) DEBUG|(844051) Building response >Thread-43::DEBUG::2014-09-04 21:02:05,489::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.78390355-2a2d-41e5-aea5-fb426559f747' for lock type 'shared' >Thread-14::DEBUG::2014-09-04 21:02:05,494::__init__::225::IOProcess::(_processLogs) (844051) Queuing response >Thread-43::DEBUG::2014-09-04 21:02:05,498::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.78390355-2a2d-41e5-aea5-fb426559f747' is free. Now locking as 'shared' (1 active user) >Thread-14::DEBUG::2014-09-04 21:02:05,500::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-43::DEBUG::2014-09-04 21:02:05,503::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.78390355-2a2d-41e5-aea5-fb426559f747`ReqID=`c5241185-25a0-4154-b3ab-eedf7c4bbe5c`::Granted request >Thread-14::DEBUG::2014-09-04 21:02:05,507::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-43::DEBUG::2014-09-04 21:02:05,517::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`dce4f17a-6cbb-4d25-89e7-969807845ab7`::_resourcesAcquired: Storage.78390355-2a2d-41e5-aea5-fb426559f747 (shared) >Thread-43::DEBUG::2014-09-04 21:02:05,523::task::993::Storage.TaskManager.Task::(_decref) Task=`dce4f17a-6cbb-4d25-89e7-969807845ab7`::ref 1 aborting False >Thread-14::DEBUG::2014-09-04 21:02:05,534::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-10379::DEBUG::2014-09-04 21:02:05,540::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mavital/7ad04229-b793-4f73-ad10-5e41a4e836ff/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-14::DEBUG::2014-09-04 21:02:05,541::__init__::225::IOProcess::(_processLogs) Message size is 190 >Thread-14::DEBUG::2014-09-04 21:02:05,875::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:02:05,883::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-10379::DEBUG::2014-09-04 21:02:05,885::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n339 bytes (339 B) copied, 0.000346926 s, 977 kB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-04 21:02:05,889::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:02:05,894::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:02:05,898::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:02:05,902::__init__::225::IOProcess::(_processLogs) (844052) Finding callback 'statvfs'... >Thread-14::DEBUG::2014-09-04 21:02:05,906::__init__::225::IOProcess::(_processLogs) (844052) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-04 21:02:05,910::__init__::225::IOProcess::(_processLogs) DEBUG|(844052) Building response >Thread-14::DEBUG::2014-09-04 21:02:05,914::__init__::225::IOProcess::(_processLogs) (844052) Queuing response >Thread-14::DEBUG::2014-09-04 21:02:05,918::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:02:05,922::__init__::225::IOProcess::(_processLogs) Sending response sized 329 >Thread-14::DEBUG::2014-09-04 21:02:05,940::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-14::DEBUG::2014-09-04 21:02:05,945::__init__::225::IOProcess::(_processLogs) Message size is 166 >Thread-14::DEBUG::2014-09-04 21:02:05,948::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:02:05,949::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-04 21:02:05,952::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:02:05,954::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:02:05,956::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:02:05,959::__init__::225::IOProcess::(_processLogs) (844053) Finding callback 'statvfs'... >Thread-43::INFO::2014-09-04 21:02:05,962::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': u'/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_qa_shared__iso__domain/7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 8L, 'domains': '180c43ee-5baf-41b7-87c7-c0214b51fe8f:Active,7ad04229-b793-4f73-ad10-5e41a4e836ff:Active,7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6:Active', 'master_uuid': u'180c43ee-5baf-41b7-87c7-c0214b51fe8f', 'version': '3', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'180c43ee-5baf-41b7-87c7-c0214b51fe8f': {'status': 'Active', 'diskfree': '1820606660608', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246104576', 'version': 3}, '7ad04229-b793-4f73-ad10-5e41a4e836ff': {'status': 'Active', 'diskfree': '1820606660608', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246104576', 'version': 0}, '7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6': {'status': 'Active', 'diskfree': '18881708032', 'isoprefix': u'/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_qa_shared__iso__domain/7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '652611682304', 'version': 0}}} >Thread-14::DEBUG::2014-09-04 21:02:05,963::__init__::225::IOProcess::(_processLogs) (844053) Got request for method 'statvfs' >Thread-43::DEBUG::2014-09-04 21:02:05,966::task::1191::Storage.TaskManager.Task::(prepare) Task=`dce4f17a-6cbb-4d25-89e7-969807845ab7`::finished: {'info': {'name': 'No Description', 'isoprefix': u'/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_qa_shared__iso__domain/7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 8L, 'domains': '180c43ee-5baf-41b7-87c7-c0214b51fe8f:Active,7ad04229-b793-4f73-ad10-5e41a4e836ff:Active,7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6:Active', 'master_uuid': u'180c43ee-5baf-41b7-87c7-c0214b51fe8f', 'version': '3', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'180c43ee-5baf-41b7-87c7-c0214b51fe8f': {'status': 'Active', 'diskfree': '1820606660608', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246104576', 'version': 3}, '7ad04229-b793-4f73-ad10-5e41a4e836ff': {'status': 'Active', 'diskfree': '1820606660608', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246104576', 'version': 0}, '7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6': {'status': 'Active', 'diskfree': '18881708032', 'isoprefix': u'/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_qa_shared__iso__domain/7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '652611682304', 'version': 0}}} >Thread-14::DEBUG::2014-09-04 21:02:05,967::__init__::225::IOProcess::(_processLogs) DEBUG|(844053) Building response >Thread-43::DEBUG::2014-09-04 21:02:05,969::task::595::Storage.TaskManager.Task::(_updateState) Task=`dce4f17a-6cbb-4d25-89e7-969807845ab7`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-09-04 21:02:05,971::__init__::225::IOProcess::(_processLogs) (844053) Queuing response >Thread-43::DEBUG::2014-09-04 21:02:05,972::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.78390355-2a2d-41e5-aea5-fb426559f747': < ResourceRef 'Storage.78390355-2a2d-41e5-aea5-fb426559f747', isValid: 'True' obj: 'None'>} >Thread-14::DEBUG::2014-09-04 21:02:05,975::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-43::DEBUG::2014-09-04 21:02:05,975::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-09-04 21:02:05,979::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-43::DEBUG::2014-09-04 21:02:05,981::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.78390355-2a2d-41e5-aea5-fb426559f747' >Thread-43::DEBUG::2014-09-04 21:02:05,987::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.78390355-2a2d-41e5-aea5-fb426559f747' (0 active users) >Thread-43::DEBUG::2014-09-04 21:02:05,990::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.78390355-2a2d-41e5-aea5-fb426559f747' is free, finding out if anyone is waiting for it. >Thread-43::DEBUG::2014-09-04 21:02:05,994::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.78390355-2a2d-41e5-aea5-fb426559f747', Clearing records. >Thread-14::DEBUG::2014-09-04 21:02:05,996::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-14::DEBUG::2014-09-04 21:02:06,001::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-43::DEBUG::2014-09-04 21:02:06,002::task::993::Storage.TaskManager.Task::(_decref) Task=`dce4f17a-6cbb-4d25-89e7-969807845ab7`::ref 0 aborting False >Thread-14::DEBUG::2014-09-04 21:02:06,005::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:02:06,009::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-04 21:02:06,012::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:02:06,016::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:02:06,020::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:02:06,023::__init__::225::IOProcess::(_processLogs) (844054) Finding callback 'statvfs'... >Thread-14::DEBUG::2014-09-04 21:02:06,025::__init__::225::IOProcess::(_processLogs) (844054) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-04 21:02:06,027::__init__::225::IOProcess::(_processLogs) DEBUG|(844054) Building response >Thread-14::DEBUG::2014-09-04 21:02:06,029::__init__::225::IOProcess::(_processLogs) (844054) Queuing response >Thread-14::DEBUG::2014-09-04 21:02:06,031::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:02:06,032::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-14::DEBUG::2014-09-04 21:02:06,041::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-14::DEBUG::2014-09-04 21:02:06,044::__init__::225::IOProcess::(_processLogs) Message size is 183 >Thread-14::DEBUG::2014-09-04 21:02:06,046::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:02:06,048::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-04 21:02:06,050::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:02:06,052::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:02:06,054::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:02:06,056::__init__::225::IOProcess::(_processLogs) (844055) Finding callback 'access'... >Thread-14::DEBUG::2014-09-04 21:02:06,057::__init__::225::IOProcess::(_processLogs) (844055) Got request for method 'access' >Thread-14::DEBUG::2014-09-04 21:02:06,059::__init__::225::IOProcess::(_processLogs) (844055) Building response >Thread-14::DEBUG::2014-09-04 21:02:06,061::__init__::225::IOProcess::(_processLogs) (844055) Queuing response >Thread-14::DEBUG::2014-09-04 21:02:06,062::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:02:06,064::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-14::DEBUG::2014-09-04 21:02:06,072::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-14::DEBUG::2014-09-04 21:02:06,074::__init__::225::IOProcess::(_processLogs) Message size is 187 >Thread-14::DEBUG::2014-09-04 21:02:06,076::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:02:06,078::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-04 21:02:06,080::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:02:06,082::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:02:06,085::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:02:06,087::__init__::225::IOProcess::(_processLogs) (844056) Finding callback 'access'... >Thread-14::DEBUG::2014-09-04 21:02:06,089::__init__::225::IOProcess::(_processLogs) (844056) Got request for method 'access' >Thread-14::DEBUG::2014-09-04 21:02:06,091::__init__::225::IOProcess::(_processLogs) DEBUG|(844056) Building response >Thread-14::DEBUG::2014-09-04 21:02:06,094::__init__::225::IOProcess::(_processLogs) (844056) Queuing response >Thread-14::DEBUG::2014-09-04 21:02:06,096::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:02:06,098::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-14::DEBUG::2014-09-04 21:02:06,106::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-14::DEBUG::2014-09-04 21:02:06,108::__init__::225::IOProcess::(_processLogs) Message size is 189 >Thread-14::DEBUG::2014-09-04 21:02:06,110::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:02:06,112::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-04 21:02:06,115::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:02:06,117::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:02:06,119::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-14::DEBUG::2014-09-04 21:02:06,121::__init__::225::IOProcess::(_processLogs) (844057) Finding callback 'access'... >Thread-14::DEBUG::2014-09-04 21:02:06,123::__init__::225::IOProcess::(_processLogs) (844057) Got request for method 'access' >Thread-14::DEBUG::2014-09-04 21:02:06,125::__init__::225::IOProcess::(_processLogs) (844057) Building response >Thread-14::DEBUG::2014-09-04 21:02:06,127::__init__::225::IOProcess::(_processLogs) (844057) Queuing response >Thread-14::DEBUG::2014-09-04 21:02:06,130::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:02:06,132::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-13916::DEBUG::2014-09-04 21:02:08,028::task::595::Storage.TaskManager.Task::(_updateState) Task=`c5b857af-5f1e-422b-80ac-6e1a86e252aa`::moving from state init -> state preparing >Thread-13916::INFO::2014-09-04 21:02:08,028::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13916::INFO::2014-09-04 21:02:08,028::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180c43ee-5baf-41b7-87c7-c0214b51fe8f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000403066', 'lastCheck': '1.9', 'valid': True}, '7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000608691', 'lastCheck': '2.1', 'valid': True}, '7ad04229-b793-4f73-ad10-5e41a4e836ff': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000346926', 'lastCheck': '2.0', 'valid': True}} >Thread-13916::DEBUG::2014-09-04 21:02:08,028::task::1191::Storage.TaskManager.Task::(prepare) Task=`c5b857af-5f1e-422b-80ac-6e1a86e252aa`::finished: {'180c43ee-5baf-41b7-87c7-c0214b51fe8f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000403066', 'lastCheck': '1.9', 'valid': True}, '7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000608691', 'lastCheck': '2.1', 'valid': True}, '7ad04229-b793-4f73-ad10-5e41a4e836ff': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000346926', 'lastCheck': '2.0', 'valid': True}} >Thread-13916::DEBUG::2014-09-04 21:02:08,028::task::595::Storage.TaskManager.Task::(_updateState) Task=`c5b857af-5f1e-422b-80ac-6e1a86e252aa`::moving from state preparing -> state finished >Thread-13916::DEBUG::2014-09-04 21:02:08,029::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13916::DEBUG::2014-09-04 21:02:08,029::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13916::DEBUG::2014-09-04 21:02:08,029::task::993::Storage.TaskManager.Task::(_decref) Task=`c5b857af-5f1e-422b-80ac-6e1a86e252aa`::ref 0 aborting False >Thread-13916::DEBUG::2014-09-04 21:02:08,050::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >Thread-13916::DEBUG::2014-09-04 21:02:08,051::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >GuestMonitor-quota__vm::DEBUG::2014-09-04 21:02:08,134::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >GuestMonitor-numa__test::DEBUG::2014-09-04 21:02:08,135::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >GuestMonitor-quota__vm::DEBUG::2014-09-04 21:02:08,139::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >GuestMonitor-numa__test::DEBUG::2014-09-04 21:02:08,140::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >GuestMonitor-quota__vm::DEBUG::2014-09-04 21:02:08,144::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >GuestMonitor-numa__test::DEBUG::2014-09-04 21:02:08,145::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >Dummy-41::DEBUG::2014-09-04 21:02:08,251::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/78390355-2a2d-41e5-aea5-fb426559f747/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-41::DEBUG::2014-09-04 21:02:08,624::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.012816 s, 79.9 MB/s\n'; <rc> = 0 >Dummy-41::DEBUG::2014-09-04 21:02:10,636::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/78390355-2a2d-41e5-aea5-fb426559f747/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-41::DEBUG::2014-09-04 21:02:11,292::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0126282 s, 81.1 MB/s\n'; <rc> = 0 >GuestMonitor-quota__vm::DEBUG::2014-09-04 21:02:13,156::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >GuestMonitor-numa__test::DEBUG::2014-09-04 21:02:13,157::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >GuestMonitor-quota__vm::DEBUG::2014-09-04 21:02:13,162::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >GuestMonitor-numa__test::DEBUG::2014-09-04 21:02:13,162::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >GuestMonitor-quota__vm::DEBUG::2014-09-04 21:02:13,167::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >GuestMonitor-numa__test::DEBUG::2014-09-04 21:02:13,167::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >Dummy-41::DEBUG::2014-09-04 21:02:13,306::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/78390355-2a2d-41e5-aea5-fb426559f747/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-41::DEBUG::2014-09-04 21:02:13,665::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0131147 s, 78.1 MB/s\n'; <rc> = 0 >Dummy-41::DEBUG::2014-09-04 21:02:15,677::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/78390355-2a2d-41e5-aea5-fb426559f747/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-14::DEBUG::2014-09-04 21:02:16,010::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-14::DEBUG::2014-09-04 21:02:16,013::__init__::225::IOProcess::(_processLogs) Message size is 190 >Thread-14::DEBUG::2014-09-04 21:02:16,016::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:02:16,019::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-14::DEBUG::2014-09-04 21:02:16,023::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:02:16,026::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:02:16,029::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:02:16,032::__init__::225::IOProcess::(_processLogs) (844058) Finding callback 'statvfs'... >Thread-14::DEBUG::2014-09-04 21:02:16,036::__init__::225::IOProcess::(_processLogs) (844058) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-04 21:02:16,038::__init__::225::IOProcess::(_processLogs) (844058) Building response >Thread-14::DEBUG::2014-09-04 21:02:16,043::__init__::225::IOProcess::(_processLogs) (844058) Queuing response >Thread-13916::DEBUG::2014-09-04 21:02:16,047::BindingXMLRPC::318::vds::(wrapper) client [10.35.163.104] flowID [6f7264b3] >Thread-14::DEBUG::2014-09-04 21:02:16,050::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:02:16,054::__init__::225::IOProcess::(_processLogs) Sending response sized 329 >Thread-13916::DEBUG::2014-09-04 21:02:16,055::task::595::Storage.TaskManager.Task::(_updateState) Task=`51ce1b4a-b6ca-4737-8714-8f6072661efd`::moving from state init -> state preparing >Thread-13916::INFO::2014-09-04 21:02:16,058::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='78390355-2a2d-41e5-aea5-fb426559f747', options=None) >Thread-18::DEBUG::2014-09-04 21:02:16,064::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_qa_shared__iso__domain/7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-14::DEBUG::2014-09-04 21:02:16,064::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-13916::INFO::2014-09-04 21:02:16,392::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 8L}} >Thread-14::DEBUG::2014-09-04 21:02:16,402::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-13916::DEBUG::2014-09-04 21:02:16,405::task::1191::Storage.TaskManager.Task::(prepare) Task=`51ce1b4a-b6ca-4737-8714-8f6072661efd`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 8L}} >Thread-18::DEBUG::2014-09-04 21:02:16,571::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1618 bytes (1.6 kB) copied, 0.000830729 s, 1.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-04 21:02:16,582::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-13916::DEBUG::2014-09-04 21:02:16,583::task::595::Storage.TaskManager.Task::(_updateState) Task=`51ce1b4a-b6ca-4737-8714-8f6072661efd`::moving from state preparing -> state finished >Thread-13916::DEBUG::2014-09-04 21:02:16,596::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-09-04 21:02:16,596::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-13916::DEBUG::2014-09-04 21:02:16,601::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-09-04 21:02:16,601::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-13916::DEBUG::2014-09-04 21:02:16,605::task::993::Storage.TaskManager.Task::(_decref) Task=`51ce1b4a-b6ca-4737-8714-8f6072661efd`::ref 0 aborting False >Thread-14::DEBUG::2014-09-04 21:02:16,606::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Dummy-41::DEBUG::2014-09-04 21:02:16,652::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.596612 s, 1.7 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-04 21:02:16,653::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:02:16,658::__init__::225::IOProcess::(_processLogs) (844059) Finding callback 'statvfs'... >Thread-14::DEBUG::2014-09-04 21:02:16,661::__init__::225::IOProcess::(_processLogs) (844059) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-04 21:02:16,663::__init__::225::IOProcess::(_processLogs) DEBUG|(844059) Building response >Thread-14::DEBUG::2014-09-04 21:02:16,666::__init__::225::IOProcess::(_processLogs) (844059) Queuing response >Thread-14::DEBUG::2014-09-04 21:02:16,668::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:02:16,670::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-43::DEBUG::2014-09-04 21:02:16,680::BindingXMLRPC::318::vds::(wrapper) client [10.35.163.104] flowID [6f7264b3] >Thread-43::DEBUG::2014-09-04 21:02:16,688::task::595::Storage.TaskManager.Task::(_updateState) Task=`d01d17c2-2e90-4226-a431-983eac2e907e`::moving from state init -> state preparing >Thread-14::DEBUG::2014-09-04 21:02:16,689::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-10379::DEBUG::2014-09-04 21:02:16,692::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mavital/7ad04229-b793-4f73-ad10-5e41a4e836ff/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-43::INFO::2014-09-04 21:02:16,692::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='78390355-2a2d-41e5-aea5-fb426559f747', options=None) >Thread-14::DEBUG::2014-09-04 21:02:16,695::__init__::225::IOProcess::(_processLogs) Message size is 166 >Thread-14::DEBUG::2014-09-04 21:02:17,187::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:02:17,194::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-10379::DEBUG::2014-09-04 21:02:17,193::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n339 bytes (339 B) copied, 0.000344058 s, 985 kB/s\n'; <rc> = 0 >Thread-43::DEBUG::2014-09-04 21:02:17,194::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.78390355-2a2d-41e5-aea5-fb426559f747`ReqID=`895ee92b-506d-4da0-ac63-8a8d818f23c4`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-14::DEBUG::2014-09-04 21:02:17,200::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-43::DEBUG::2014-09-04 21:02:17,202::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.78390355-2a2d-41e5-aea5-fb426559f747' for lock type 'shared' >Thread-14::DEBUG::2014-09-04 21:02:17,205::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-43::DEBUG::2014-09-04 21:02:17,209::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.78390355-2a2d-41e5-aea5-fb426559f747' is free. Now locking as 'shared' (1 active user) >Thread-14::DEBUG::2014-09-04 21:02:17,209::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-43::DEBUG::2014-09-04 21:02:17,212::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.78390355-2a2d-41e5-aea5-fb426559f747`ReqID=`895ee92b-506d-4da0-ac63-8a8d818f23c4`::Granted request >Thread-14::DEBUG::2014-09-04 21:02:17,213::__init__::225::IOProcess::(_processLogs) (844060) Finding callback 'statvfs'... >Thread-14::DEBUG::2014-09-04 21:02:17,217::__init__::225::IOProcess::(_processLogs) (844060) Got request for method 'statvfs' >Thread-43::DEBUG::2014-09-04 21:02:17,221::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`d01d17c2-2e90-4226-a431-983eac2e907e`::_resourcesAcquired: Storage.78390355-2a2d-41e5-aea5-fb426559f747 (shared) >Thread-14::DEBUG::2014-09-04 21:02:17,221::__init__::225::IOProcess::(_processLogs) DEBUG|(844060) Building response >Thread-43::DEBUG::2014-09-04 21:02:17,225::task::993::Storage.TaskManager.Task::(_decref) Task=`d01d17c2-2e90-4226-a431-983eac2e907e`::ref 1 aborting False >Thread-14::DEBUG::2014-09-04 21:02:17,226::__init__::225::IOProcess::(_processLogs) (844060) Queuing response >Thread-14::DEBUG::2014-09-04 21:02:17,230::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:02:17,234::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-14::DEBUG::2014-09-04 21:02:17,254::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-17::DEBUG::2014-09-04 21:02:17,259::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_artyom__storage__rhevm__35/180c43ee-5baf-41b7-87c7-c0214b51fe8f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-14::DEBUG::2014-09-04 21:02:17,259::__init__::225::IOProcess::(_processLogs) Message size is 190 >Thread-14::DEBUG::2014-09-04 21:02:17,917::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:02:17,926::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-17::DEBUG::2014-09-04 21:02:17,927::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n474 bytes (474 B) copied, 0.000347328 s, 1.4 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-04 21:02:17,934::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:02:17,942::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:02:17,947::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:02:17,952::__init__::225::IOProcess::(_processLogs) (844061) Finding callback 'statvfs'... >Thread-14::DEBUG::2014-09-04 21:02:17,956::__init__::225::IOProcess::(_processLogs) (844061) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-04 21:02:17,960::__init__::225::IOProcess::(_processLogs) DEBUG|(844061) Building response >Thread-14::DEBUG::2014-09-04 21:02:17,963::__init__::225::IOProcess::(_processLogs) (844061) Queuing response >Thread-14::DEBUG::2014-09-04 21:02:17,967::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:02:17,971::__init__::225::IOProcess::(_processLogs) Sending response sized 329 >Thread-14::DEBUG::2014-09-04 21:02:17,986::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-14::DEBUG::2014-09-04 21:02:17,992::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-43::INFO::2014-09-04 21:02:17,995::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': u'/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_qa_shared__iso__domain/7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 8L, 'domains': '180c43ee-5baf-41b7-87c7-c0214b51fe8f:Active,7ad04229-b793-4f73-ad10-5e41a4e836ff:Active,7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6:Active', 'master_uuid': u'180c43ee-5baf-41b7-87c7-c0214b51fe8f', 'version': '3', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'180c43ee-5baf-41b7-87c7-c0214b51fe8f': {'status': 'Active', 'diskfree': '1820606595072', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246104576', 'version': 3}, '7ad04229-b793-4f73-ad10-5e41a4e836ff': {'status': 'Active', 'diskfree': '1820606595072', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246104576', 'version': 0}, '7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6': {'status': 'Active', 'diskfree': '18881708032', 'isoprefix': u'/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_qa_shared__iso__domain/7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '652611682304', 'version': 0}}} >Thread-14::DEBUG::2014-09-04 21:02:17,996::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-43::DEBUG::2014-09-04 21:02:17,999::task::1191::Storage.TaskManager.Task::(prepare) Task=`d01d17c2-2e90-4226-a431-983eac2e907e`::finished: {'info': {'name': 'No Description', 'isoprefix': u'/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_qa_shared__iso__domain/7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 8L, 'domains': '180c43ee-5baf-41b7-87c7-c0214b51fe8f:Active,7ad04229-b793-4f73-ad10-5e41a4e836ff:Active,7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6:Active', 'master_uuid': u'180c43ee-5baf-41b7-87c7-c0214b51fe8f', 'version': '3', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'180c43ee-5baf-41b7-87c7-c0214b51fe8f': {'status': 'Active', 'diskfree': '1820606595072', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246104576', 'version': 3}, '7ad04229-b793-4f73-ad10-5e41a4e836ff': {'status': 'Active', 'diskfree': '1820606595072', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246104576', 'version': 0}, '7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6': {'status': 'Active', 'diskfree': '18881708032', 'isoprefix': u'/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_qa_shared__iso__domain/7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '652611682304', 'version': 0}}} >Thread-14::DEBUG::2014-09-04 21:02:18,001::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-43::DEBUG::2014-09-04 21:02:18,002::task::595::Storage.TaskManager.Task::(_updateState) Task=`d01d17c2-2e90-4226-a431-983eac2e907e`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-09-04 21:02:18,005::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-43::DEBUG::2014-09-04 21:02:18,006::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.78390355-2a2d-41e5-aea5-fb426559f747': < ResourceRef 'Storage.78390355-2a2d-41e5-aea5-fb426559f747', isValid: 'True' obj: 'None'>} >Thread-14::DEBUG::2014-09-04 21:02:18,009::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-43::DEBUG::2014-09-04 21:02:18,009::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-09-04 21:02:18,013::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-43::DEBUG::2014-09-04 21:02:18,016::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.78390355-2a2d-41e5-aea5-fb426559f747' >Thread-14::DEBUG::2014-09-04 21:02:18,017::__init__::225::IOProcess::(_processLogs) (844062) Finding callback 'statvfs'... >Thread-43::DEBUG::2014-09-04 21:02:18,021::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.78390355-2a2d-41e5-aea5-fb426559f747' (0 active users) >Thread-14::DEBUG::2014-09-04 21:02:18,022::__init__::225::IOProcess::(_processLogs) (844062) Got request for method 'statvfs' >Thread-43::DEBUG::2014-09-04 21:02:18,024::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.78390355-2a2d-41e5-aea5-fb426559f747' is free, finding out if anyone is waiting for it. >Thread-14::DEBUG::2014-09-04 21:02:18,027::__init__::225::IOProcess::(_processLogs) DEBUG|(844062) Building response >Thread-43::DEBUG::2014-09-04 21:02:18,027::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.78390355-2a2d-41e5-aea5-fb426559f747', Clearing records. >Thread-14::DEBUG::2014-09-04 21:02:18,030::__init__::225::IOProcess::(_processLogs) (844062) Queuing response >Thread-43::DEBUG::2014-09-04 21:02:18,034::task::993::Storage.TaskManager.Task::(_decref) Task=`d01d17c2-2e90-4226-a431-983eac2e907e`::ref 0 aborting False >Thread-14::DEBUG::2014-09-04 21:02:18,035::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:02:18,039::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-14::DEBUG::2014-09-04 21:02:18,059::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-14::DEBUG::2014-09-04 21:02:18,066::__init__::225::IOProcess::(_processLogs) Message size is 166 >Thread-14::DEBUG::2014-09-04 21:02:18,070::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:02:18,074::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-04 21:02:18,079::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:02:18,083::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:02:18,087::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:02:18,092::__init__::225::IOProcess::(_processLogs) (844063) Finding callback 'statvfs'... >Thread-14::DEBUG::2014-09-04 21:02:18,096::__init__::225::IOProcess::(_processLogs) (844063) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-04 21:02:18,102::__init__::225::IOProcess::(_processLogs) DEBUG|(844063) Building response >Thread-14::DEBUG::2014-09-04 21:02:18,106::__init__::225::IOProcess::(_processLogs) (844063) Queuing response >Thread-14::DEBUG::2014-09-04 21:02:18,111::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:02:18,115::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-14::DEBUG::2014-09-04 21:02:18,138::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-14::DEBUG::2014-09-04 21:02:18,141::__init__::225::IOProcess::(_processLogs) Message size is 183 >Thread-14::DEBUG::2014-09-04 21:02:18,144::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:02:18,147::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-04 21:02:18,150::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:02:18,152::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:02:18,155::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:02:18,158::__init__::225::IOProcess::(_processLogs) (844064) Finding callback 'access'... >Thread-14::DEBUG::2014-09-04 21:02:18,160::__init__::225::IOProcess::(_processLogs) (844064) Got request for method 'access' >Thread-14::DEBUG::2014-09-04 21:02:18,163::__init__::225::IOProcess::(_processLogs) DEBUG|(844064) Building response >Thread-14::DEBUG::2014-09-04 21:02:18,167::__init__::225::IOProcess::(_processLogs) (844064) Queuing response >Thread-14::DEBUG::2014-09-04 21:02:18,169::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:02:18,172::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >GuestMonitor-numa__test::DEBUG::2014-09-04 21:02:18,184::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >GuestMonitor-quota__vm::DEBUG::2014-09-04 21:02:18,188::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >Thread-14::DEBUG::2014-09-04 21:02:18,192::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-14::DEBUG::2014-09-04 21:02:18,198::__init__::225::IOProcess::(_processLogs) Message size is 187 >Thread-14::DEBUG::2014-09-04 21:02:18,204::__init__::225::IOProcess::(_processLogs) Marshaling message... >GuestMonitor-numa__test::DEBUG::2014-09-04 21:02:18,205::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >Thread-14::DEBUG::2014-09-04 21:02:18,210::__init__::225::IOProcess::(_processLogs) Queuing request... >GuestMonitor-quota__vm::DEBUG::2014-09-04 21:02:18,213::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >Thread-14::DEBUG::2014-09-04 21:02:18,215::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:02:18,221::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:02:18,226::__init__::225::IOProcess::(_processLogs) Extracting request information... >GuestMonitor-numa__test::DEBUG::2014-09-04 21:02:18,228::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >Thread-14::DEBUG::2014-09-04 21:02:18,231::__init__::225::IOProcess::(_processLogs) (844065) Finding callback 'access'... >Thread-14::DEBUG::2014-09-04 21:02:18,237::__init__::225::IOProcess::(_processLogs) (844065) Got request for method 'access' >GuestMonitor-quota__vm::DEBUG::2014-09-04 21:02:18,238::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >Thread-14::DEBUG::2014-09-04 21:02:18,242::__init__::225::IOProcess::(_processLogs) (844065) Building response >Thread-14::DEBUG::2014-09-04 21:02:18,246::__init__::225::IOProcess::(_processLogs) (844065) Queuing response >Thread-14::DEBUG::2014-09-04 21:02:18,250::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:02:18,253::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-14::DEBUG::2014-09-04 21:02:18,264::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-14::DEBUG::2014-09-04 21:02:18,267::__init__::225::IOProcess::(_processLogs) Message size is 189 >Thread-14::DEBUG::2014-09-04 21:02:18,270::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:02:18,273::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-04 21:02:18,276::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:02:18,279::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:02:18,283::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-14::DEBUG::2014-09-04 21:02:18,286::__init__::225::IOProcess::(_processLogs) (844066) Finding callback 'access'... >Thread-14::DEBUG::2014-09-04 21:02:18,289::__init__::225::IOProcess::(_processLogs) (844066) Got request for method 'access' >Thread-14::DEBUG::2014-09-04 21:02:18,292::__init__::225::IOProcess::(_processLogs) (844066) Building response >Thread-14::DEBUG::2014-09-04 21:02:18,295::__init__::225::IOProcess::(_processLogs) (844066) Queuing response >Thread-14::DEBUG::2014-09-04 21:02:18,299::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:02:18,302::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-41::DEBUG::2014-09-04 21:02:20,395::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/78390355-2a2d-41e5-aea5-fb426559f747/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-41::DEBUG::2014-09-04 21:02:20,774::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0127144 s, 80.5 MB/s\n'; <rc> = 0 >Dummy-41::DEBUG::2014-09-04 21:02:22,822::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/78390355-2a2d-41e5-aea5-fb426559f747/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >GuestMonitor-numa__test::DEBUG::2014-09-04 21:02:23,346::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >GuestMonitor-quota__vm::DEBUG::2014-09-04 21:02:23,350::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >GuestMonitor-numa__test::DEBUG::2014-09-04 21:02:23,362::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >GuestMonitor-quota__vm::DEBUG::2014-09-04 21:02:23,365::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >GuestMonitor-numa__test::DEBUG::2014-09-04 21:02:23,379::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >GuestMonitor-quota__vm::DEBUG::2014-09-04 21:02:23,382::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >Dummy-41::DEBUG::2014-09-04 21:02:23,673::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.240952 s, 4.2 MB/s\n'; <rc> = 0 >Thread-13916::DEBUG::2014-09-04 21:02:23,974::task::595::Storage.TaskManager.Task::(_updateState) Task=`bb0f76d3-f9d6-452f-af03-3dc9bb8a767d`::moving from state init -> state preparing >Thread-13916::INFO::2014-09-04 21:02:23,974::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13916::INFO::2014-09-04 21:02:23,974::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180c43ee-5baf-41b7-87c7-c0214b51fe8f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000347328', 'lastCheck': '5.7', 'valid': True}, '7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000830729', 'lastCheck': '6.0', 'valid': True}, '7ad04229-b793-4f73-ad10-5e41a4e836ff': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000344058', 'lastCheck': '5.9', 'valid': True}} >Thread-13916::DEBUG::2014-09-04 21:02:23,975::task::1191::Storage.TaskManager.Task::(prepare) Task=`bb0f76d3-f9d6-452f-af03-3dc9bb8a767d`::finished: {'180c43ee-5baf-41b7-87c7-c0214b51fe8f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000347328', 'lastCheck': '5.7', 'valid': True}, '7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000830729', 'lastCheck': '6.0', 'valid': True}, '7ad04229-b793-4f73-ad10-5e41a4e836ff': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000344058', 'lastCheck': '5.9', 'valid': True}} >Thread-13916::DEBUG::2014-09-04 21:02:23,975::task::595::Storage.TaskManager.Task::(_updateState) Task=`bb0f76d3-f9d6-452f-af03-3dc9bb8a767d`::moving from state preparing -> state finished >Thread-13916::DEBUG::2014-09-04 21:02:23,975::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13916::DEBUG::2014-09-04 21:02:23,975::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13916::DEBUG::2014-09-04 21:02:23,975::task::993::Storage.TaskManager.Task::(_decref) Task=`bb0f76d3-f9d6-452f-af03-3dc9bb8a767d`::ref 0 aborting False >Thread-13916::DEBUG::2014-09-04 21:02:23,997::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >Thread-13916::DEBUG::2014-09-04 21:02:23,998::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >Dummy-41::DEBUG::2014-09-04 21:02:25,690::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/78390355-2a2d-41e5-aea5-fb426559f747/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-41::DEBUG::2014-09-04 21:02:26,082::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0389334 s, 26.3 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-04 21:02:27,992::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-14::DEBUG::2014-09-04 21:02:27,993::__init__::225::IOProcess::(_processLogs) Message size is 190 >Thread-14::DEBUG::2014-09-04 21:02:27,993::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:02:27,993::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-14::DEBUG::2014-09-04 21:02:27,993::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:02:27,993::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:02:27,993::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:02:27,994::__init__::225::IOProcess::(_processLogs) (844067) Finding callback 'statvfs'... >Thread-14::DEBUG::2014-09-04 21:02:27,994::__init__::225::IOProcess::(_processLogs) (844067) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-04 21:02:28,003::__init__::225::IOProcess::(_processLogs) DEBUG|(844067) Building response >Thread-14::DEBUG::2014-09-04 21:02:28,004::__init__::225::IOProcess::(_processLogs) (844067) Queuing response >Thread-14::DEBUG::2014-09-04 21:02:28,004::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-14::DEBUG::2014-09-04 21:02:28,004::__init__::225::IOProcess::(_processLogs) Sending response sized 329 >Thread-18::DEBUG::2014-09-04 21:02:28,005::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_qa_shared__iso__domain/7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Dummy-41::DEBUG::2014-09-04 21:02:28,342::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/78390355-2a2d-41e5-aea5-fb426559f747/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-14::DEBUG::2014-09-04 21:02:28,347::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-13916::DEBUG::2014-09-04 21:02:28,348::BindingXMLRPC::318::vds::(wrapper) client [10.35.163.104] >Thread-18::DEBUG::2014-09-04 21:02:28,680::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1618 bytes (1.6 kB) copied, 0.00149145 s, 1.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-04 21:02:28,698::__init__::225::IOProcess::(_processLogs) Message size is 166 >GuestMonitor-numa__test::DEBUG::2014-09-04 21:02:28,707::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >GuestMonitor-quota__vm::DEBUG::2014-09-04 21:02:28,710::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >Thread-14::DEBUG::2014-09-04 21:02:28,712::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-13916::DEBUG::2014-09-04 21:02:28,712::task::595::Storage.TaskManager.Task::(_updateState) Task=`cc2ced4a-43c6-4f2b-bec8-e54da561f734`::moving from state init -> state preparing >Thread-14::DEBUG::2014-09-04 21:02:28,721::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-13916::INFO::2014-09-04 21:02:28,725::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='78390355-2a2d-41e5-aea5-fb426559f747', options=None) >Thread-14::DEBUG::2014-09-04 21:02:28,732::__init__::225::IOProcess::(_processLogs) Waiting for next request... >GuestMonitor-numa__test::DEBUG::2014-09-04 21:02:28,740::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >Thread-14::DEBUG::2014-09-04 21:02:28,741::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >GuestMonitor-quota__vm::DEBUG::2014-09-04 21:02:28,747::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >Thread-13916::INFO::2014-09-04 21:02:28,750::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 8L}} >Thread-14::DEBUG::2014-09-04 21:02:28,752::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-13916::DEBUG::2014-09-04 21:02:28,761::task::1191::Storage.TaskManager.Task::(prepare) Task=`cc2ced4a-43c6-4f2b-bec8-e54da561f734`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 8L}} >Thread-14::DEBUG::2014-09-04 21:02:28,762::__init__::225::IOProcess::(_processLogs) (844068) Finding callback 'statvfs'... >Thread-13916::DEBUG::2014-09-04 21:02:28,768::task::595::Storage.TaskManager.Task::(_updateState) Task=`cc2ced4a-43c6-4f2b-bec8-e54da561f734`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-09-04 21:02:28,771::__init__::225::IOProcess::(_processLogs) (844068) Got request for method 'statvfs' >Thread-13916::DEBUG::2014-09-04 21:02:28,776::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >GuestMonitor-numa__test::DEBUG::2014-09-04 21:02:28,778::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >Thread-14::DEBUG::2014-09-04 21:02:28,782::__init__::225::IOProcess::(_processLogs) DEBUG|(844068) Building response >Thread-13916::DEBUG::2014-09-04 21:02:28,783::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >GuestMonitor-quota__vm::DEBUG::2014-09-04 21:02:28,789::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >Thread-14::DEBUG::2014-09-04 21:02:28,791::__init__::225::IOProcess::(_processLogs) (844068) Queuing response >Thread-13916::DEBUG::2014-09-04 21:02:28,793::task::993::Storage.TaskManager.Task::(_decref) Task=`cc2ced4a-43c6-4f2b-bec8-e54da561f734`::ref 0 aborting False >Thread-14::DEBUG::2014-09-04 21:02:28,801::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:02:28,809::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-14::DEBUG::2014-09-04 21:02:29,002::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-43::DEBUG::2014-09-04 21:02:29,007::BindingXMLRPC::318::vds::(wrapper) client [10.35.163.104] >Thread-17::DEBUG::2014-09-04 21:02:29,009::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_artyom__storage__rhevm__35/180c43ee-5baf-41b7-87c7-c0214b51fe8f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-14::DEBUG::2014-09-04 21:02:29,012::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-43::DEBUG::2014-09-04 21:02:29,534::task::595::Storage.TaskManager.Task::(_updateState) Task=`0aef4c27-fb03-4fae-982e-974a4d1610dc`::moving from state init -> state preparing >Thread-14::DEBUG::2014-09-04 21:02:29,539::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-43::INFO::2014-09-04 21:02:29,547::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='78390355-2a2d-41e5-aea5-fb426559f747', options=None) >Thread-14::DEBUG::2014-09-04 21:02:29,550::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-17::DEBUG::2014-09-04 21:02:29,549::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n474 bytes (474 B) copied, 0.000307778 s, 1.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-04 21:02:29,595::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Dummy-41::DEBUG::2014-09-04 21:02:29,597::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.860306 s, 1.2 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-04 21:02:29,601::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-43::DEBUG::2014-09-04 21:02:29,601::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.78390355-2a2d-41e5-aea5-fb426559f747`ReqID=`0eeba6fc-0ca2-4e2d-bf5c-ed10a7ddce92`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-43::DEBUG::2014-09-04 21:02:29,604::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.78390355-2a2d-41e5-aea5-fb426559f747' for lock type 'shared' >Thread-14::DEBUG::2014-09-04 21:02:29,605::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:02:29,610::__init__::225::IOProcess::(_processLogs) (844069) Finding callback 'statvfs'... >Thread-43::DEBUG::2014-09-04 21:02:29,610::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.78390355-2a2d-41e5-aea5-fb426559f747' is free. Now locking as 'shared' (1 active user) >Thread-43::DEBUG::2014-09-04 21:02:29,613::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.78390355-2a2d-41e5-aea5-fb426559f747`ReqID=`0eeba6fc-0ca2-4e2d-bf5c-ed10a7ddce92`::Granted request >Thread-14::DEBUG::2014-09-04 21:02:29,613::__init__::225::IOProcess::(_processLogs) (844069) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-04 21:02:29,619::__init__::225::IOProcess::(_processLogs) DEBUG|(844069) Building response >Thread-43::DEBUG::2014-09-04 21:02:29,623::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`0aef4c27-fb03-4fae-982e-974a4d1610dc`::_resourcesAcquired: Storage.78390355-2a2d-41e5-aea5-fb426559f747 (shared) >Thread-14::DEBUG::2014-09-04 21:02:29,623::__init__::225::IOProcess::(_processLogs) (844069) Queuing response >Thread-43::DEBUG::2014-09-04 21:02:29,627::task::993::Storage.TaskManager.Task::(_decref) Task=`0aef4c27-fb03-4fae-982e-974a4d1610dc`::ref 1 aborting False >Thread-14::DEBUG::2014-09-04 21:02:29,628::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:02:29,632::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-14::DEBUG::2014-09-04 21:02:29,651::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-14::DEBUG::2014-09-04 21:02:29,656::__init__::225::IOProcess::(_processLogs) Message size is 190 >Thread-10379::DEBUG::2014-09-04 21:02:29,655::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mavital/7ad04229-b793-4f73-ad10-5e41a4e836ff/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-14::DEBUG::2014-09-04 21:02:29,661::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:02:30,320::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-04 21:02:30,330::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-10379::DEBUG::2014-09-04 21:02:30,330::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n339 bytes (339 B) copied, 0.000321343 s, 1.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-04 21:02:30,338::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:02:30,345::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:02:30,350::__init__::225::IOProcess::(_processLogs) (844070) Finding callback 'statvfs'... >Thread-14::DEBUG::2014-09-04 21:02:30,354::__init__::225::IOProcess::(_processLogs) (844070) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-04 21:02:30,358::__init__::225::IOProcess::(_processLogs) DEBUG|(844070) Building response >Thread-14::DEBUG::2014-09-04 21:02:30,363::__init__::225::IOProcess::(_processLogs) (844070) Queuing response >Thread-14::DEBUG::2014-09-04 21:02:30,367::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:02:30,371::__init__::225::IOProcess::(_processLogs) Sending response sized 329 >Thread-14::DEBUG::2014-09-04 21:02:30,384::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-14::DEBUG::2014-09-04 21:02:30,389::__init__::225::IOProcess::(_processLogs) Message size is 166 >Thread-14::DEBUG::2014-09-04 21:02:30,393::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-43::INFO::2014-09-04 21:02:30,393::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': u'/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_qa_shared__iso__domain/7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 8L, 'domains': '180c43ee-5baf-41b7-87c7-c0214b51fe8f:Active,7ad04229-b793-4f73-ad10-5e41a4e836ff:Active,7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6:Active', 'master_uuid': u'180c43ee-5baf-41b7-87c7-c0214b51fe8f', 'version': '3', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'180c43ee-5baf-41b7-87c7-c0214b51fe8f': {'status': 'Active', 'diskfree': '1820606595072', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246104576', 'version': 3}, '7ad04229-b793-4f73-ad10-5e41a4e836ff': {'status': 'Active', 'diskfree': '1820606595072', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246104576', 'version': 0}, '7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6': {'status': 'Active', 'diskfree': '18881708032', 'isoprefix': u'/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_qa_shared__iso__domain/7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '652611682304', 'version': 0}}} >Thread-14::DEBUG::2014-09-04 21:02:30,395::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-43::DEBUG::2014-09-04 21:02:30,397::task::1191::Storage.TaskManager.Task::(prepare) Task=`0aef4c27-fb03-4fae-982e-974a4d1610dc`::finished: {'info': {'name': 'No Description', 'isoprefix': u'/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_qa_shared__iso__domain/7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 8L, 'domains': '180c43ee-5baf-41b7-87c7-c0214b51fe8f:Active,7ad04229-b793-4f73-ad10-5e41a4e836ff:Active,7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6:Active', 'master_uuid': u'180c43ee-5baf-41b7-87c7-c0214b51fe8f', 'version': '3', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'180c43ee-5baf-41b7-87c7-c0214b51fe8f': {'status': 'Active', 'diskfree': '1820606595072', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246104576', 'version': 3}, '7ad04229-b793-4f73-ad10-5e41a4e836ff': {'status': 'Active', 'diskfree': '1820606595072', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246104576', 'version': 0}, '7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6': {'status': 'Active', 'diskfree': '18881708032', 'isoprefix': u'/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_qa_shared__iso__domain/7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '652611682304', 'version': 0}}} >Thread-14::DEBUG::2014-09-04 21:02:30,398::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-43::DEBUG::2014-09-04 21:02:30,400::task::595::Storage.TaskManager.Task::(_updateState) Task=`0aef4c27-fb03-4fae-982e-974a4d1610dc`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-09-04 21:02:30,401::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-43::DEBUG::2014-09-04 21:02:30,403::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.78390355-2a2d-41e5-aea5-fb426559f747': < ResourceRef 'Storage.78390355-2a2d-41e5-aea5-fb426559f747', isValid: 'True' obj: 'None'>} >Thread-14::DEBUG::2014-09-04 21:02:30,404::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-43::DEBUG::2014-09-04 21:02:30,406::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-09-04 21:02:30,407::__init__::225::IOProcess::(_processLogs) (844071) Finding callback 'statvfs'... >Thread-14::DEBUG::2014-09-04 21:02:30,410::__init__::225::IOProcess::(_processLogs) (844071) Got request for method 'statvfs' >Thread-43::DEBUG::2014-09-04 21:02:30,412::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.78390355-2a2d-41e5-aea5-fb426559f747' >Thread-14::DEBUG::2014-09-04 21:02:30,413::__init__::225::IOProcess::(_processLogs) DEBUG|(844071) Building response >Thread-14::DEBUG::2014-09-04 21:02:30,416::__init__::225::IOProcess::(_processLogs) (844071) Queuing response >Thread-43::DEBUG::2014-09-04 21:02:30,417::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.78390355-2a2d-41e5-aea5-fb426559f747' (0 active users) >Thread-43::DEBUG::2014-09-04 21:02:30,420::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.78390355-2a2d-41e5-aea5-fb426559f747' is free, finding out if anyone is waiting for it. >Thread-14::DEBUG::2014-09-04 21:02:30,420::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-43::DEBUG::2014-09-04 21:02:30,422::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.78390355-2a2d-41e5-aea5-fb426559f747', Clearing records. >Thread-14::DEBUG::2014-09-04 21:02:30,424::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-43::DEBUG::2014-09-04 21:02:30,428::task::993::Storage.TaskManager.Task::(_decref) Task=`0aef4c27-fb03-4fae-982e-974a4d1610dc`::ref 0 aborting False >Thread-14::DEBUG::2014-09-04 21:02:30,442::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-14::DEBUG::2014-09-04 21:02:30,447::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-14::DEBUG::2014-09-04 21:02:30,451::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:02:30,453::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-04 21:02:30,455::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:02:30,458::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:02:30,460::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:02:30,463::__init__::225::IOProcess::(_processLogs) (844072) Finding callback 'statvfs'... >Thread-14::DEBUG::2014-09-04 21:02:30,465::__init__::225::IOProcess::(_processLogs) (844072) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-04 21:02:30,468::__init__::225::IOProcess::(_processLogs) DEBUG|(844072) Building response >Thread-14::DEBUG::2014-09-04 21:02:30,470::__init__::225::IOProcess::(_processLogs) (844072) Queuing response >Thread-14::DEBUG::2014-09-04 21:02:30,472::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:02:30,475::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-14::DEBUG::2014-09-04 21:02:30,485::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-14::DEBUG::2014-09-04 21:02:30,488::__init__::225::IOProcess::(_processLogs) Message size is 183 >Thread-14::DEBUG::2014-09-04 21:02:30,491::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:02:30,493::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-04 21:02:30,494::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:02:30,496::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:02:30,498::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:02:30,500::__init__::225::IOProcess::(_processLogs) (844073) Finding callback 'access'... >Thread-14::DEBUG::2014-09-04 21:02:30,503::__init__::225::IOProcess::(_processLogs) (844073) Got request for method 'access' >Thread-14::DEBUG::2014-09-04 21:02:30,504::__init__::225::IOProcess::(_processLogs) (844073) Building response >Thread-14::DEBUG::2014-09-04 21:02:30,506::__init__::225::IOProcess::(_processLogs) (844073) Queuing response >Thread-14::DEBUG::2014-09-04 21:02:30,508::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:02:30,510::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-14::DEBUG::2014-09-04 21:02:30,517::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-14::DEBUG::2014-09-04 21:02:30,519::__init__::225::IOProcess::(_processLogs) Message size is 187 >Thread-14::DEBUG::2014-09-04 21:02:30,522::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:02:30,524::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-04 21:02:30,526::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:02:30,528::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:02:30,530::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:02:30,532::__init__::225::IOProcess::(_processLogs) (844074) Finding callback 'access'... >Thread-14::DEBUG::2014-09-04 21:02:30,534::__init__::225::IOProcess::(_processLogs) (844074) Got request for method 'access' >Thread-14::DEBUG::2014-09-04 21:02:30,536::__init__::225::IOProcess::(_processLogs) (844074) Building response >Thread-14::DEBUG::2014-09-04 21:02:30,538::__init__::225::IOProcess::(_processLogs) (844074) Queuing response >Thread-14::DEBUG::2014-09-04 21:02:30,541::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:02:30,543::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-14::DEBUG::2014-09-04 21:02:30,550::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-14::DEBUG::2014-09-04 21:02:30,552::__init__::225::IOProcess::(_processLogs) Message size is 189 >Thread-14::DEBUG::2014-09-04 21:02:30,554::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:02:30,556::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-04 21:02:30,559::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:02:30,561::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:02:30,564::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:02:30,566::__init__::225::IOProcess::(_processLogs) (844075) Finding callback 'access'... >Thread-14::DEBUG::2014-09-04 21:02:30,568::__init__::225::IOProcess::(_processLogs) (844075) Got request for method 'access' >Thread-14::DEBUG::2014-09-04 21:02:30,570::__init__::225::IOProcess::(_processLogs) (844075) Building response >Thread-14::DEBUG::2014-09-04 21:02:30,572::__init__::225::IOProcess::(_processLogs) (844075) Queuing response >Thread-14::DEBUG::2014-09-04 21:02:30,574::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-14::DEBUG::2014-09-04 21:02:30,576::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-41::DEBUG::2014-09-04 21:02:32,675::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/78390355-2a2d-41e5-aea5-fb426559f747/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-41::DEBUG::2014-09-04 21:02:33,053::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.014406 s, 71.1 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-09-04 21:02:33,366::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-09-04 21:02:33,366::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 57. >GuestMonitor-numa__test::DEBUG::2014-09-04 21:02:33,809::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >GuestMonitor-numa__test::DEBUG::2014-09-04 21:02:33,810::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >GuestMonitor-numa__test::DEBUG::2014-09-04 21:02:33,810::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >GuestMonitor-quota__vm::DEBUG::2014-09-04 21:02:33,820::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >GuestMonitor-quota__vm::DEBUG::2014-09-04 21:02:33,821::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >GuestMonitor-quota__vm::DEBUG::2014-09-04 21:02:33,822::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >Dummy-41::DEBUG::2014-09-04 21:02:35,073::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/78390355-2a2d-41e5-aea5-fb426559f747/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-41::DEBUG::2014-09-04 21:02:35,620::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.182945 s, 5.6 MB/s\n'; <rc> = 0 >Thread-9196::DEBUG::2014-09-04 21:02:37,014::task::595::Storage.TaskManager.Task::(_updateState) Task=`3af95801-f04a-4cbf-be61-6f9f69ade74b`::moving from state init -> state preparing >Thread-9196::INFO::2014-09-04 21:02:37,015::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='180c43ee-5baf-41b7-87c7-c0214b51fe8f', spUUID='78390355-2a2d-41e5-aea5-fb426559f747', imgUUID='e8bb0473-2d86-4f1c-9d82-2c9690c52427', volUUID='bed5a4ba-eae0-49bf-a6b2-be81e7c21100', options=None) >Thread-14::DEBUG::2014-09-04 21:02:37,016::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-14::DEBUG::2014-09-04 21:02:37,016::__init__::225::IOProcess::(_processLogs) Message size is 244 >Thread-14::DEBUG::2014-09-04 21:02:37,016::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-14::DEBUG::2014-09-04 21:02:37,016::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-04 21:02:37,016::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:02:37,016::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:02:37,017::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-14::DEBUG::2014-09-04 21:02:37,017::__init__::225::IOProcess::(_processLogs) (844076) Finding callback 'stat'... >Thread-14::DEBUG::2014-09-04 21:02:37,017::__init__::225::IOProcess::(_processLogs) (844076) Got request for method 'stat' >Thread-14::DEBUG::2014-09-04 21:02:37,017::__init__::225::IOProcess::(_processLogs) DEBUG|(844076) Building response >Thread-14::DEBUG::2014-09-04 21:02:37,017::__init__::225::IOProcess::(_processLogs) (844076) Queuing response >Thread-14::DEBUG::2014-09-04 21:02:37,018::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-14::DEBUG::2014-09-04 21:02:37,018::__init__::225::IOProcess::(_processLogs) Sending response sized 327 >Thread-14::DEBUG::2014-09-04 21:02:37,019::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-14::DEBUG::2014-09-04 21:02:37,019::__init__::225::IOProcess::(_processLogs) Message size is 244 >Thread-14::DEBUG::2014-09-04 21:02:37,019::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:02:37,019::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-14::DEBUG::2014-09-04 21:02:37,020::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:02:37,020::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:02:37,020::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-14::DEBUG::2014-09-04 21:02:37,020::__init__::225::IOProcess::(_processLogs) (844077) Finding callback 'stat'... >Thread-14::DEBUG::2014-09-04 21:02:37,020::__init__::225::IOProcess::(_processLogs) (844077) Got request for method 'stat' >Thread-14::DEBUG::2014-09-04 21:02:37,020::__init__::225::IOProcess::(_processLogs) (844077) Building response >Thread-14::DEBUG::2014-09-04 21:02:37,020::__init__::225::IOProcess::(_processLogs) (844077) Queuing response >Thread-14::DEBUG::2014-09-04 21:02:37,020::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:02:37,021::__init__::225::IOProcess::(_processLogs) Sending response sized 327 >Thread-9196::INFO::2014-09-04 21:02:37,021::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '24576', 'apparentsize': '1073741824'} >Thread-9196::DEBUG::2014-09-04 21:02:37,021::task::1191::Storage.TaskManager.Task::(prepare) Task=`3af95801-f04a-4cbf-be61-6f9f69ade74b`::finished: {'truesize': '24576', 'apparentsize': '1073741824'} >Thread-9196::DEBUG::2014-09-04 21:02:37,022::task::595::Storage.TaskManager.Task::(_updateState) Task=`3af95801-f04a-4cbf-be61-6f9f69ade74b`::moving from state preparing -> state finished >Thread-9196::DEBUG::2014-09-04 21:02:37,022::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-9196::DEBUG::2014-09-04 21:02:37,022::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-9196::DEBUG::2014-09-04 21:02:37,022::task::993::Storage.TaskManager.Task::(_decref) Task=`3af95801-f04a-4cbf-be61-6f9f69ade74b`::ref 0 aborting False >Dummy-41::DEBUG::2014-09-04 21:02:37,636::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/78390355-2a2d-41e5-aea5-fb426559f747/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-41::DEBUG::2014-09-04 21:02:38,015::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0128813 s, 79.5 MB/s\n'; <rc> = 0 >GuestMonitor-numa__test::DEBUG::2014-09-04 21:02:38,816::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >GuestMonitor-numa__test::DEBUG::2014-09-04 21:02:38,817::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >GuestMonitor-numa__test::DEBUG::2014-09-04 21:02:38,818::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >GuestMonitor-quota__vm::DEBUG::2014-09-04 21:02:38,828::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >GuestMonitor-quota__vm::DEBUG::2014-09-04 21:02:38,829::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >GuestMonitor-quota__vm::DEBUG::2014-09-04 21:02:38,829::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >Thread-13916::DEBUG::2014-09-04 21:02:39,384::task::595::Storage.TaskManager.Task::(_updateState) Task=`4bf831f7-c24a-4c27-917c-372afe7014ad`::moving from state init -> state preparing >Thread-13916::INFO::2014-09-04 21:02:39,384::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13916::INFO::2014-09-04 21:02:39,385::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180c43ee-5baf-41b7-87c7-c0214b51fe8f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000307778', 'lastCheck': '8.8', 'valid': True}, '7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00149145', 'lastCheck': '9.0', 'valid': True}, '7ad04229-b793-4f73-ad10-5e41a4e836ff': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000321343', 'lastCheck': '8.9', 'valid': True}} >Thread-13916::DEBUG::2014-09-04 21:02:39,385::task::1191::Storage.TaskManager.Task::(prepare) Task=`4bf831f7-c24a-4c27-917c-372afe7014ad`::finished: {'180c43ee-5baf-41b7-87c7-c0214b51fe8f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000307778', 'lastCheck': '8.8', 'valid': True}, '7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00149145', 'lastCheck': '9.0', 'valid': True}, '7ad04229-b793-4f73-ad10-5e41a4e836ff': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000321343', 'lastCheck': '8.9', 'valid': True}} >Thread-13916::DEBUG::2014-09-04 21:02:39,385::task::595::Storage.TaskManager.Task::(_updateState) Task=`4bf831f7-c24a-4c27-917c-372afe7014ad`::moving from state preparing -> state finished >Thread-13916::DEBUG::2014-09-04 21:02:39,385::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13916::DEBUG::2014-09-04 21:02:39,385::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13916::DEBUG::2014-09-04 21:02:39,385::task::993::Storage.TaskManager.Task::(_decref) Task=`4bf831f7-c24a-4c27-917c-372afe7014ad`::ref 0 aborting False >Thread-13916::DEBUG::2014-09-04 21:02:39,409::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >Thread-13916::DEBUG::2014-09-04 21:02:39,409::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >Dummy-41::DEBUG::2014-09-04 21:02:40,026::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/78390355-2a2d-41e5-aea5-fb426559f747/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-41::DEBUG::2014-09-04 21:02:40,404::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0124887 s, 82.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-04 21:02:40,406::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-14::DEBUG::2014-09-04 21:02:40,407::__init__::225::IOProcess::(_processLogs) Message size is 190 >Thread-14::DEBUG::2014-09-04 21:02:40,408::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:02:40,408::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-04 21:02:40,410::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:02:40,412::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:02:40,415::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:02:40,416::__init__::225::IOProcess::(_processLogs) (844078) Finding callback 'statvfs'... >Thread-14::DEBUG::2014-09-04 21:02:40,417::__init__::225::IOProcess::(_processLogs) (844078) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-04 21:02:40,418::__init__::225::IOProcess::(_processLogs) (844078) Building response >Thread-14::DEBUG::2014-09-04 21:02:40,419::__init__::225::IOProcess::(_processLogs) (844078) Queuing response >Thread-14::DEBUG::2014-09-04 21:02:40,419::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:02:40,420::__init__::225::IOProcess::(_processLogs) Sending response sized 329 >Thread-18::DEBUG::2014-09-04 21:02:40,425::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_qa_shared__iso__domain/7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-14::DEBUG::2014-09-04 21:02:40,754::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-13916::DEBUG::2014-09-04 21:02:40,755::BindingXMLRPC::318::vds::(wrapper) client [10.35.163.104] >Thread-18::DEBUG::2014-09-04 21:02:40,757::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1618 bytes (1.6 kB) copied, 0.000918718 s, 1.8 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-04 21:02:40,759::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-13916::DEBUG::2014-09-04 21:02:40,766::task::595::Storage.TaskManager.Task::(_updateState) Task=`1177e7d8-7a77-4625-9377-79a1f328b222`::moving from state init -> state preparing >Thread-14::DEBUG::2014-09-04 21:02:40,766::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-13916::INFO::2014-09-04 21:02:40,770::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='78390355-2a2d-41e5-aea5-fb426559f747', options=None) >Thread-14::DEBUG::2014-09-04 21:02:40,771::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-04 21:02:40,775::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:02:40,779::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:02:40,781::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:02:40,784::__init__::225::IOProcess::(_processLogs) (844079) Finding callback 'statvfs'... >Thread-13916::INFO::2014-09-04 21:02:40,787::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 8L}} >Thread-14::DEBUG::2014-09-04 21:02:40,787::__init__::225::IOProcess::(_processLogs) (844079) Got request for method 'statvfs' >Thread-13916::DEBUG::2014-09-04 21:02:40,791::task::1191::Storage.TaskManager.Task::(prepare) Task=`1177e7d8-7a77-4625-9377-79a1f328b222`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 8L}} >Thread-14::DEBUG::2014-09-04 21:02:40,792::__init__::225::IOProcess::(_processLogs) DEBUG|(844079) Building response >Thread-13916::DEBUG::2014-09-04 21:02:40,794::task::595::Storage.TaskManager.Task::(_updateState) Task=`1177e7d8-7a77-4625-9377-79a1f328b222`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-09-04 21:02:40,795::__init__::225::IOProcess::(_processLogs) (844079) Queuing response >Thread-13916::DEBUG::2014-09-04 21:02:40,797::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-09-04 21:02:40,800::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-13916::DEBUG::2014-09-04 21:02:40,801::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-09-04 21:02:40,803::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-13916::DEBUG::2014-09-04 21:02:40,805::task::993::Storage.TaskManager.Task::(_decref) Task=`1177e7d8-7a77-4625-9377-79a1f328b222`::ref 0 aborting False >Thread-14::DEBUG::2014-09-04 21:02:40,820::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-10379::DEBUG::2014-09-04 21:02:40,823::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mavital/7ad04229-b793-4f73-ad10-5e41a4e836ff/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-14::DEBUG::2014-09-04 21:02:40,823::__init__::225::IOProcess::(_processLogs) Message size is 166 >Thread-14::DEBUG::2014-09-04 21:02:41,172::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-43::DEBUG::2014-09-04 21:02:41,359::BindingXMLRPC::318::vds::(wrapper) client [10.35.163.104] >Thread-10379::DEBUG::2014-09-04 21:02:41,368::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n339 bytes (339 B) copied, 0.000357839 s, 947 kB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-04 21:02:41,368::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-43::DEBUG::2014-09-04 21:02:41,381::task::595::Storage.TaskManager.Task::(_updateState) Task=`d6690570-2b01-440a-b185-e059d46b8571`::moving from state init -> state preparing >Thread-43::INFO::2014-09-04 21:02:41,387::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='78390355-2a2d-41e5-aea5-fb426559f747', options=None) >Thread-14::DEBUG::2014-09-04 21:02:41,390::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-43::DEBUG::2014-09-04 21:02:41,400::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.78390355-2a2d-41e5-aea5-fb426559f747`ReqID=`012a5096-88e3-4dff-81f9-64aa43350c6a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-43::DEBUG::2014-09-04 21:02:41,405::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.78390355-2a2d-41e5-aea5-fb426559f747' for lock type 'shared' >Thread-14::DEBUG::2014-09-04 21:02:41,405::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-43::DEBUG::2014-09-04 21:02:41,415::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.78390355-2a2d-41e5-aea5-fb426559f747' is free. Now locking as 'shared' (1 active user) >Thread-43::DEBUG::2014-09-04 21:02:41,424::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.78390355-2a2d-41e5-aea5-fb426559f747`ReqID=`012a5096-88e3-4dff-81f9-64aa43350c6a`::Granted request >Thread-14::DEBUG::2014-09-04 21:02:41,426::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-43::DEBUG::2014-09-04 21:02:41,436::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`d6690570-2b01-440a-b185-e059d46b8571`::_resourcesAcquired: Storage.78390355-2a2d-41e5-aea5-fb426559f747 (shared) >Thread-43::DEBUG::2014-09-04 21:02:41,441::task::993::Storage.TaskManager.Task::(_decref) Task=`d6690570-2b01-440a-b185-e059d46b8571`::ref 1 aborting False >Thread-14::DEBUG::2014-09-04 21:02:41,442::__init__::225::IOProcess::(_processLogs) (844080) Finding callback 'statvfs'... >Thread-14::DEBUG::2014-09-04 21:02:41,460::__init__::225::IOProcess::(_processLogs) (844080) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-04 21:02:41,474::__init__::225::IOProcess::(_processLogs) DEBUG|(844080) Building response >Thread-14::DEBUG::2014-09-04 21:02:41,483::__init__::225::IOProcess::(_processLogs) (844080) Queuing response >Thread-14::DEBUG::2014-09-04 21:02:41,491::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:02:41,495::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-14::DEBUG::2014-09-04 21:02:41,513::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-17::DEBUG::2014-09-04 21:02:41,677::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_artyom__storage__rhevm__35/180c43ee-5baf-41b7-87c7-c0214b51fe8f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-14::DEBUG::2014-09-04 21:02:41,680::__init__::225::IOProcess::(_processLogs) Message size is 190 >Thread-9209::DEBUG::2014-09-04 21:02:41,685::task::595::Storage.TaskManager.Task::(_updateState) Task=`193aa7d6-29ea-4770-9fef-ac6ba0fdde69`::moving from state init -> state preparing >Thread-14::DEBUG::2014-09-04 21:02:42,308::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-9209::INFO::2014-09-04 21:02:42,312::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='180c43ee-5baf-41b7-87c7-c0214b51fe8f', spUUID='78390355-2a2d-41e5-aea5-fb426559f747', imgUUID='70069763-69d2-42a9-86e7-23db8019e0b3', volUUID='0f679bfe-49c1-4e90-b02a-4f075a42fda5', options=None) >Thread-14::DEBUG::2014-09-04 21:02:42,317::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-17::DEBUG::2014-09-04 21:02:42,316::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n474 bytes (474 B) copied, 0.0003562 s, 1.3 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-04 21:02:42,323::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:02:42,326::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:02:42,329::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:02:42,333::__init__::225::IOProcess::(_processLogs) (844081) Finding callback 'statvfs'... >Thread-43::INFO::2014-09-04 21:02:42,335::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': u'/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_qa_shared__iso__domain/7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 8L, 'domains': '180c43ee-5baf-41b7-87c7-c0214b51fe8f:Active,7ad04229-b793-4f73-ad10-5e41a4e836ff:Active,7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6:Active', 'master_uuid': u'180c43ee-5baf-41b7-87c7-c0214b51fe8f', 'version': '3', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'180c43ee-5baf-41b7-87c7-c0214b51fe8f': {'status': 'Active', 'diskfree': '1820606529536', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246104576', 'version': 3}, '7ad04229-b793-4f73-ad10-5e41a4e836ff': {'status': 'Active', 'diskfree': '1820606529536', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246104576', 'version': 0}, '7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6': {'status': 'Active', 'diskfree': '18881708032', 'isoprefix': u'/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_qa_shared__iso__domain/7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '652611682304', 'version': 0}}} >Thread-14::DEBUG::2014-09-04 21:02:42,337::__init__::225::IOProcess::(_processLogs) (844081) Got request for method 'statvfs' >Thread-43::DEBUG::2014-09-04 21:02:42,339::task::1191::Storage.TaskManager.Task::(prepare) Task=`d6690570-2b01-440a-b185-e059d46b8571`::finished: {'info': {'name': 'No Description', 'isoprefix': u'/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_qa_shared__iso__domain/7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 8L, 'domains': '180c43ee-5baf-41b7-87c7-c0214b51fe8f:Active,7ad04229-b793-4f73-ad10-5e41a4e836ff:Active,7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6:Active', 'master_uuid': u'180c43ee-5baf-41b7-87c7-c0214b51fe8f', 'version': '3', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'180c43ee-5baf-41b7-87c7-c0214b51fe8f': {'status': 'Active', 'diskfree': '1820606529536', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246104576', 'version': 3}, '7ad04229-b793-4f73-ad10-5e41a4e836ff': {'status': 'Active', 'diskfree': '1820606529536', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246104576', 'version': 0}, '7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6': {'status': 'Active', 'diskfree': '18881708032', 'isoprefix': u'/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_qa_shared__iso__domain/7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '652611682304', 'version': 0}}} >Thread-14::DEBUG::2014-09-04 21:02:42,341::__init__::225::IOProcess::(_processLogs) DEBUG|(844081) Building response >Thread-43::DEBUG::2014-09-04 21:02:42,343::task::595::Storage.TaskManager.Task::(_updateState) Task=`d6690570-2b01-440a-b185-e059d46b8571`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-09-04 21:02:42,345::__init__::225::IOProcess::(_processLogs) (844081) Queuing response >Thread-43::DEBUG::2014-09-04 21:02:42,346::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.78390355-2a2d-41e5-aea5-fb426559f747': < ResourceRef 'Storage.78390355-2a2d-41e5-aea5-fb426559f747', isValid: 'True' obj: 'None'>} >Thread-14::DEBUG::2014-09-04 21:02:42,349::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-43::DEBUG::2014-09-04 21:02:42,350::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-09-04 21:02:42,353::__init__::225::IOProcess::(_processLogs) Sending response sized 329 >Thread-43::DEBUG::2014-09-04 21:02:42,356::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.78390355-2a2d-41e5-aea5-fb426559f747' >Thread-43::DEBUG::2014-09-04 21:02:42,362::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.78390355-2a2d-41e5-aea5-fb426559f747' (0 active users) >Thread-43::DEBUG::2014-09-04 21:02:42,365::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.78390355-2a2d-41e5-aea5-fb426559f747' is free, finding out if anyone is waiting for it. >Thread-43::DEBUG::2014-09-04 21:02:42,369::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.78390355-2a2d-41e5-aea5-fb426559f747', Clearing records. >Thread-14::DEBUG::2014-09-04 21:02:42,370::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-14::DEBUG::2014-09-04 21:02:42,376::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-43::DEBUG::2014-09-04 21:02:42,378::task::993::Storage.TaskManager.Task::(_decref) Task=`d6690570-2b01-440a-b185-e059d46b8571`::ref 0 aborting False >Thread-14::DEBUG::2014-09-04 21:02:42,381::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:02:42,385::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-04 21:02:42,389::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:02:42,393::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:02:42,397::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:02:42,401::__init__::225::IOProcess::(_processLogs) (844082) Finding callback 'statvfs'... >Thread-14::DEBUG::2014-09-04 21:02:42,404::__init__::225::IOProcess::(_processLogs) (844082) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-04 21:02:42,407::__init__::225::IOProcess::(_processLogs) DEBUG|(844082) Building response >Thread-14::DEBUG::2014-09-04 21:02:42,410::__init__::225::IOProcess::(_processLogs) (844082) Queuing response >Thread-14::DEBUG::2014-09-04 21:02:42,412::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:02:42,415::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-14::DEBUG::2014-09-04 21:02:42,428::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-14::DEBUG::2014-09-04 21:02:42,432::__init__::225::IOProcess::(_processLogs) Message size is 244 >Thread-14::DEBUG::2014-09-04 21:02:42,434::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:02:42,437::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-04 21:02:42,440::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:02:42,442::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:02:42,445::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:02:42,447::__init__::225::IOProcess::(_processLogs) (844083) Finding callback 'stat'... >Thread-14::DEBUG::2014-09-04 21:02:42,451::__init__::225::IOProcess::(_processLogs) (844083) Got request for method 'stat' >Thread-14::DEBUG::2014-09-04 21:02:42,457::__init__::225::IOProcess::(_processLogs) DEBUG|(844083) Building response >Thread-14::DEBUG::2014-09-04 21:02:42,461::__init__::225::IOProcess::(_processLogs) (844083) Queuing response >Thread-14::DEBUG::2014-09-04 21:02:42,465::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:02:42,469::__init__::225::IOProcess::(_processLogs) Sending response sized 327 >Thread-14::DEBUG::2014-09-04 21:02:42,481::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-14::DEBUG::2014-09-04 21:02:42,484::__init__::225::IOProcess::(_processLogs) Message size is 166 >Thread-14::DEBUG::2014-09-04 21:02:42,487::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:02:42,489::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-04 21:02:42,492::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:02:42,495::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:02:42,497::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:02:42,499::__init__::225::IOProcess::(_processLogs) (844084) Finding callback 'statvfs'... >Thread-14::DEBUG::2014-09-04 21:02:42,502::__init__::225::IOProcess::(_processLogs) (844084) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-04 21:02:42,504::__init__::225::IOProcess::(_processLogs) (844084) Building response >Thread-14::DEBUG::2014-09-04 21:02:42,507::__init__::225::IOProcess::(_processLogs) DEBUG|(844084) Queuing response >Thread-14::DEBUG::2014-09-04 21:02:42,510::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:02:42,513::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-14::DEBUG::2014-09-04 21:02:42,525::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-14::DEBUG::2014-09-04 21:02:42,529::__init__::225::IOProcess::(_processLogs) Message size is 244 >Thread-14::DEBUG::2014-09-04 21:02:42,531::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:02:42,533::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-04 21:02:42,536::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:02:42,539::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:02:42,541::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:02:42,544::__init__::225::IOProcess::(_processLogs) (844085) Finding callback 'stat'... >Thread-14::DEBUG::2014-09-04 21:02:42,547::__init__::225::IOProcess::(_processLogs) (844085) Got request for method 'stat' >Thread-14::DEBUG::2014-09-04 21:02:42,549::__init__::225::IOProcess::(_processLogs) (844085) Building response >Thread-14::DEBUG::2014-09-04 21:02:42,552::__init__::225::IOProcess::(_processLogs) (844085) Queuing response >Thread-14::DEBUG::2014-09-04 21:02:42,554::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:02:42,557::__init__::225::IOProcess::(_processLogs) Sending response sized 327 >Thread-14::DEBUG::2014-09-04 21:02:42,570::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-9209::INFO::2014-09-04 21:02:42,570::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '24576', 'apparentsize': '1073741824'} >Thread-14::DEBUG::2014-09-04 21:02:42,573::__init__::225::IOProcess::(_processLogs) Message size is 183 >Thread-9209::DEBUG::2014-09-04 21:02:42,574::task::1191::Storage.TaskManager.Task::(prepare) Task=`193aa7d6-29ea-4770-9fef-ac6ba0fdde69`::finished: {'truesize': '24576', 'apparentsize': '1073741824'} >Thread-14::DEBUG::2014-09-04 21:02:42,577::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-9209::DEBUG::2014-09-04 21:02:42,577::task::595::Storage.TaskManager.Task::(_updateState) Task=`193aa7d6-29ea-4770-9fef-ac6ba0fdde69`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-09-04 21:02:42,580::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-9209::DEBUG::2014-09-04 21:02:42,580::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-09-04 21:02:42,584::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-9209::DEBUG::2014-09-04 21:02:42,584::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-09-04 21:02:42,587::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-9209::DEBUG::2014-09-04 21:02:42,588::task::993::Storage.TaskManager.Task::(_decref) Task=`193aa7d6-29ea-4770-9fef-ac6ba0fdde69`::ref 0 aborting False >Thread-14::DEBUG::2014-09-04 21:02:42,591::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:02:42,594::__init__::225::IOProcess::(_processLogs) (844086) Finding callback 'access'... >Thread-14::DEBUG::2014-09-04 21:02:42,598::__init__::225::IOProcess::(_processLogs) (844086) Got request for method 'access' >Thread-14::DEBUG::2014-09-04 21:02:42,601::__init__::225::IOProcess::(_processLogs) (844086) Building response >Thread-14::DEBUG::2014-09-04 21:02:42,604::__init__::225::IOProcess::(_processLogs) (844086) Queuing response >Thread-14::DEBUG::2014-09-04 21:02:42,606::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:02:42,609::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-14::DEBUG::2014-09-04 21:02:42,619::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-14::DEBUG::2014-09-04 21:02:42,623::__init__::225::IOProcess::(_processLogs) Message size is 187 >Thread-14::DEBUG::2014-09-04 21:02:42,626::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:02:42,629::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-04 21:02:42,631::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:02:42,634::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:02:42,637::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-14::DEBUG::2014-09-04 21:02:42,639::__init__::225::IOProcess::(_processLogs) (844087) Finding callback 'access'... >Thread-14::DEBUG::2014-09-04 21:02:42,642::__init__::225::IOProcess::(_processLogs) (844087) Got request for method 'access' >Thread-14::DEBUG::2014-09-04 21:02:42,644::__init__::225::IOProcess::(_processLogs) (844087) Building response >Thread-14::DEBUG::2014-09-04 21:02:42,647::__init__::225::IOProcess::(_processLogs) (844087) Queuing response >Thread-14::DEBUG::2014-09-04 21:02:42,649::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:02:42,652::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-14::DEBUG::2014-09-04 21:02:42,662::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-14::DEBUG::2014-09-04 21:02:42,664::__init__::225::IOProcess::(_processLogs) Message size is 189 >Thread-14::DEBUG::2014-09-04 21:02:42,667::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:02:42,670::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-04 21:02:42,672::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:02:42,675::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:02:42,678::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:02:42,681::__init__::225::IOProcess::(_processLogs) (844088) Finding callback 'access'... >Thread-14::DEBUG::2014-09-04 21:02:42,683::__init__::225::IOProcess::(_processLogs) (844088) Got request for method 'access' >Thread-14::DEBUG::2014-09-04 21:02:42,686::__init__::225::IOProcess::(_processLogs) (844088) Building response >Thread-14::DEBUG::2014-09-04 21:02:42,689::__init__::225::IOProcess::(_processLogs) (844088) Queuing response >Thread-14::DEBUG::2014-09-04 21:02:42,692::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:02:42,695::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >GuestMonitor-numa__test::DEBUG::2014-09-04 21:02:43,824::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >GuestMonitor-numa__test::DEBUG::2014-09-04 21:02:43,825::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >GuestMonitor-numa__test::DEBUG::2014-09-04 21:02:43,825::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >GuestMonitor-quota__vm::DEBUG::2014-09-04 21:02:43,836::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >GuestMonitor-quota__vm::DEBUG::2014-09-04 21:02:43,837::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >GuestMonitor-quota__vm::DEBUG::2014-09-04 21:02:43,838::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >Dummy-41::DEBUG::2014-09-04 21:02:44,735::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/78390355-2a2d-41e5-aea5-fb426559f747/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-41::DEBUG::2014-09-04 21:02:45,099::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.012597 s, 81.3 MB/s\n'; <rc> = 0 >Dummy-41::DEBUG::2014-09-04 21:02:47,110::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/78390355-2a2d-41e5-aea5-fb426559f747/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-41::DEBUG::2014-09-04 21:02:47,675::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.208525 s, 4.9 MB/s\n'; <rc> = 0 >GuestMonitor-numa__test::DEBUG::2014-09-04 21:02:48,832::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >GuestMonitor-numa__test::DEBUG::2014-09-04 21:02:48,833::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >GuestMonitor-numa__test::DEBUG::2014-09-04 21:02:48,833::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >GuestMonitor-quota__vm::DEBUG::2014-09-04 21:02:48,844::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >GuestMonitor-quota__vm::DEBUG::2014-09-04 21:02:48,845::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >GuestMonitor-quota__vm::DEBUG::2014-09-04 21:02:48,845::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >Dummy-41::DEBUG::2014-09-04 21:02:49,696::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/78390355-2a2d-41e5-aea5-fb426559f747/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-41::DEBUG::2014-09-04 21:02:50,059::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0126799 s, 80.8 MB/s\n'; <rc> = 0 >Dummy-41::DEBUG::2014-09-04 21:02:52,071::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/78390355-2a2d-41e5-aea5-fb426559f747/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-14::DEBUG::2014-09-04 21:02:52,393::__init__::225::IOProcess::(_processLogs) Message size is 190 >Thread-14::DEBUG::2014-09-04 21:02:52,394::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:02:52,394::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:02:52,394::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:02:52,394::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:02:52,394::__init__::225::IOProcess::(_processLogs) (844089) Finding callback 'statvfs'... >Thread-14::DEBUG::2014-09-04 21:02:52,394::__init__::225::IOProcess::(_processLogs) (844089) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-04 21:02:52,395::__init__::225::IOProcess::(_processLogs) (844089) Queuing response >Thread-14::DEBUG::2014-09-04 21:02:52,395::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:02:52,395::__init__::225::IOProcess::(_processLogs) Sending response sized 329 >Thread-18::DEBUG::2014-09-04 21:02:52,396::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_qa_shared__iso__domain/7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-18::DEBUG::2014-09-04 21:02:52,723::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1618 bytes (1.6 kB) copied, 0.000939394 s, 1.7 MB/s\n'; <rc> = 0 >Thread-13916::DEBUG::2014-09-04 21:02:52,722::BindingXMLRPC::318::vds::(wrapper) client [10.35.163.104] >Thread-14::DEBUG::2014-09-04 21:02:52,725::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-14::DEBUG::2014-09-04 21:02:52,732::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-13916::DEBUG::2014-09-04 21:02:52,732::task::595::Storage.TaskManager.Task::(_updateState) Task=`4917e721-e154-4d9a-bdc9-763e9cf5b8bd`::moving from state init -> state preparing >Thread-14::DEBUG::2014-09-04 21:02:52,735::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-13916::INFO::2014-09-04 21:02:52,736::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='78390355-2a2d-41e5-aea5-fb426559f747', options=None) >Thread-14::DEBUG::2014-09-04 21:02:52,738::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:02:52,740::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:02:52,741::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:02:52,742::__init__::225::IOProcess::(_processLogs) (844090) Finding callback 'statvfs'... >Thread-14::DEBUG::2014-09-04 21:02:52,743::__init__::225::IOProcess::(_processLogs) (844090) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-04 21:02:52,744::__init__::225::IOProcess::(_processLogs) (844090) Building response >Thread-14::DEBUG::2014-09-04 21:02:52,745::__init__::225::IOProcess::(_processLogs) (844090) Queuing response >Thread-14::DEBUG::2014-09-04 21:02:52,746::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:02:52,747::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-14::DEBUG::2014-09-04 21:02:52,751::__init__::225::IOProcess::(_processLogs) Message size is 166 >Thread-13916::INFO::2014-09-04 21:02:52,751::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 8L}} >Thread-10379::DEBUG::2014-09-04 21:02:52,755::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mavital/7ad04229-b793-4f73-ad10-5e41a4e836ff/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-14::DEBUG::2014-09-04 21:02:52,756::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-13916::DEBUG::2014-09-04 21:02:52,758::task::1191::Storage.TaskManager.Task::(prepare) Task=`4917e721-e154-4d9a-bdc9-763e9cf5b8bd`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 8L}} >Thread-13916::DEBUG::2014-09-04 21:02:53,092::task::595::Storage.TaskManager.Task::(_updateState) Task=`4917e721-e154-4d9a-bdc9-763e9cf5b8bd`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-09-04 21:02:53,092::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-13916::DEBUG::2014-09-04 21:02:53,097::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10379::DEBUG::2014-09-04 21:02:53,099::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n339 bytes (339 B) copied, 0.000337884 s, 1.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-04 21:02:53,100::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-13916::DEBUG::2014-09-04 21:02:53,102::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-09-04 21:02:53,107::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-13916::DEBUG::2014-09-04 21:02:53,109::task::993::Storage.TaskManager.Task::(_decref) Task=`4917e721-e154-4d9a-bdc9-763e9cf5b8bd`::ref 0 aborting False >Thread-14::DEBUG::2014-09-04 21:02:53,111::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:02:53,116::__init__::225::IOProcess::(_processLogs) (844091) Finding callback 'statvfs'... >Thread-14::DEBUG::2014-09-04 21:02:53,122::__init__::225::IOProcess::(_processLogs) (844091) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-04 21:02:53,314::__init__::225::IOProcess::(_processLogs) (844091) Queuing response >Thread-43::DEBUG::2014-09-04 21:02:53,355::BindingXMLRPC::318::vds::(wrapper) client [10.35.163.104] >Dummy-41::DEBUG::2014-09-04 21:02:53,356::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.729077 s, 1.4 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-04 21:02:53,357::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:02:53,364::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-43::DEBUG::2014-09-04 21:02:53,364::task::595::Storage.TaskManager.Task::(_updateState) Task=`1b0152a5-5e91-46f9-b1ed-1c3e6fac0285`::moving from state init -> state preparing >Thread-43::INFO::2014-09-04 21:02:53,372::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='78390355-2a2d-41e5-aea5-fb426559f747', options=None) >Thread-43::DEBUG::2014-09-04 21:02:53,385::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.78390355-2a2d-41e5-aea5-fb426559f747`ReqID=`fed5592a-9d0c-4c1b-8f1f-6e732ea34c76`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-14::DEBUG::2014-09-04 21:02:53,388::__init__::225::IOProcess::(_processLogs) Message size is 190 >Thread-43::DEBUG::2014-09-04 21:02:53,390::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.78390355-2a2d-41e5-aea5-fb426559f747' for lock type 'shared' >Thread-17::DEBUG::2014-09-04 21:02:53,392::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_artyom__storage__rhevm__35/180c43ee-5baf-41b7-87c7-c0214b51fe8f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-14::DEBUG::2014-09-04 21:02:53,394::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-43::DEBUG::2014-09-04 21:02:53,743::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.78390355-2a2d-41e5-aea5-fb426559f747' is free. Now locking as 'shared' (1 active user) >Thread-14::DEBUG::2014-09-04 21:02:53,932::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-43::DEBUG::2014-09-04 21:02:53,939::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.78390355-2a2d-41e5-aea5-fb426559f747`ReqID=`fed5592a-9d0c-4c1b-8f1f-6e732ea34c76`::Granted request >Thread-17::DEBUG::2014-09-04 21:02:53,948::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n474 bytes (474 B) copied, 0.000346023 s, 1.4 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-04 21:02:53,949::__init__::225::IOProcess::(_processLogs) Waiting for next request... >GuestMonitor-numa__test::DEBUG::2014-09-04 21:02:53,952::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >GuestMonitor-quota__vm::DEBUG::2014-09-04 21:02:53,957::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >Thread-43::DEBUG::2014-09-04 21:02:53,962::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`1b0152a5-5e91-46f9-b1ed-1c3e6fac0285`::_resourcesAcquired: Storage.78390355-2a2d-41e5-aea5-fb426559f747 (shared) >Thread-14::DEBUG::2014-09-04 21:02:53,963::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-43::DEBUG::2014-09-04 21:02:53,967::task::993::Storage.TaskManager.Task::(_decref) Task=`1b0152a5-5e91-46f9-b1ed-1c3e6fac0285`::ref 1 aborting False >Thread-14::DEBUG::2014-09-04 21:02:53,972::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:02:53,981::__init__::225::IOProcess::(_processLogs) (844092) Finding callback 'statvfs'... >GuestMonitor-numa__test::DEBUG::2014-09-04 21:02:53,988::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >Thread-14::DEBUG::2014-09-04 21:02:53,989::__init__::225::IOProcess::(_processLogs) (844092) Got request for method 'statvfs' >GuestMonitor-quota__vm::DEBUG::2014-09-04 21:02:53,992::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >Thread-14::DEBUG::2014-09-04 21:02:53,998::__init__::225::IOProcess::(_processLogs) (844092) Queuing response >Thread-14::DEBUG::2014-09-04 21:02:54,004::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:02:54,011::__init__::225::IOProcess::(_processLogs) Sending response sized 329 >GuestMonitor-numa__test::DEBUG::2014-09-04 21:02:54,026::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >GuestMonitor-quota__vm::DEBUG::2014-09-04 21:02:54,032::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >Thread-14::DEBUG::2014-09-04 21:02:54,048::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-14::DEBUG::2014-09-04 21:02:54,057::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:02:54,064::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-04 21:02:54,069::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:02:54,074::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:02:54,079::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:02:54,086::__init__::225::IOProcess::(_processLogs) (844093) Finding callback 'statvfs'... >Thread-14::DEBUG::2014-09-04 21:02:54,092::__init__::225::IOProcess::(_processLogs) (844093) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-04 21:02:54,097::__init__::225::IOProcess::(_processLogs) (844093) Building response >Thread-14::DEBUG::2014-09-04 21:02:54,101::__init__::225::IOProcess::(_processLogs) (844093) Queuing response >Thread-14::DEBUG::2014-09-04 21:02:54,105::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:02:54,110::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-43::INFO::2014-09-04 21:02:54,118::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': u'/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_qa_shared__iso__domain/7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 8L, 'domains': '180c43ee-5baf-41b7-87c7-c0214b51fe8f:Active,7ad04229-b793-4f73-ad10-5e41a4e836ff:Active,7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6:Active', 'master_uuid': u'180c43ee-5baf-41b7-87c7-c0214b51fe8f', 'version': '3', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'180c43ee-5baf-41b7-87c7-c0214b51fe8f': {'status': 'Active', 'diskfree': '1820606529536', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246104576', 'version': 3}, '7ad04229-b793-4f73-ad10-5e41a4e836ff': {'status': 'Active', 'diskfree': '1820606529536', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246104576', 'version': 0}, '7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6': {'status': 'Active', 'diskfree': '18881708032', 'isoprefix': u'/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_qa_shared__iso__domain/7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '652610633728', 'version': 0}}} >Thread-43::DEBUG::2014-09-04 21:02:54,124::task::1191::Storage.TaskManager.Task::(prepare) Task=`1b0152a5-5e91-46f9-b1ed-1c3e6fac0285`::finished: {'info': {'name': 'No Description', 'isoprefix': u'/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_qa_shared__iso__domain/7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 8L, 'domains': '180c43ee-5baf-41b7-87c7-c0214b51fe8f:Active,7ad04229-b793-4f73-ad10-5e41a4e836ff:Active,7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6:Active', 'master_uuid': u'180c43ee-5baf-41b7-87c7-c0214b51fe8f', 'version': '3', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'180c43ee-5baf-41b7-87c7-c0214b51fe8f': {'status': 'Active', 'diskfree': '1820606529536', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246104576', 'version': 3}, '7ad04229-b793-4f73-ad10-5e41a4e836ff': {'status': 'Active', 'diskfree': '1820606529536', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246104576', 'version': 0}, '7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6': {'status': 'Active', 'diskfree': '18881708032', 'isoprefix': u'/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_qa_shared__iso__domain/7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '652610633728', 'version': 0}}} >Thread-43::DEBUG::2014-09-04 21:02:54,128::task::595::Storage.TaskManager.Task::(_updateState) Task=`1b0152a5-5e91-46f9-b1ed-1c3e6fac0285`::moving from state preparing -> state finished >Thread-43::DEBUG::2014-09-04 21:02:54,133::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.78390355-2a2d-41e5-aea5-fb426559f747': < ResourceRef 'Storage.78390355-2a2d-41e5-aea5-fb426559f747', isValid: 'True' obj: 'None'>} >Thread-14::DEBUG::2014-09-04 21:02:54,137::__init__::225::IOProcess::(_processLogs) Message size is 166 >Thread-43::DEBUG::2014-09-04 21:02:54,139::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-09-04 21:02:54,143::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-43::DEBUG::2014-09-04 21:02:54,146::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.78390355-2a2d-41e5-aea5-fb426559f747' >Thread-14::DEBUG::2014-09-04 21:02:54,147::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-04 21:02:54,151::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-43::DEBUG::2014-09-04 21:02:54,152::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.78390355-2a2d-41e5-aea5-fb426559f747' (0 active users) >Thread-14::DEBUG::2014-09-04 21:02:54,155::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-43::DEBUG::2014-09-04 21:02:54,155::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.78390355-2a2d-41e5-aea5-fb426559f747' is free, finding out if anyone is waiting for it. >Thread-14::DEBUG::2014-09-04 21:02:54,158::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-43::DEBUG::2014-09-04 21:02:54,158::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.78390355-2a2d-41e5-aea5-fb426559f747', Clearing records. >Thread-14::DEBUG::2014-09-04 21:02:54,162::__init__::225::IOProcess::(_processLogs) (844094) Finding callback 'statvfs'... >Thread-43::DEBUG::2014-09-04 21:02:54,165::task::993::Storage.TaskManager.Task::(_decref) Task=`1b0152a5-5e91-46f9-b1ed-1c3e6fac0285`::ref 0 aborting False >Thread-14::DEBUG::2014-09-04 21:02:54,166::__init__::225::IOProcess::(_processLogs) (844094) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-04 21:02:54,170::__init__::225::IOProcess::(_processLogs) (844094) Building response >Thread-14::DEBUG::2014-09-04 21:02:54,173::__init__::225::IOProcess::(_processLogs) (844094) Queuing response >Thread-14::DEBUG::2014-09-04 21:02:54,177::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:02:54,180::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-14::DEBUG::2014-09-04 21:02:54,197::__init__::225::IOProcess::(_processLogs) Message size is 183 >Thread-14::DEBUG::2014-09-04 21:02:54,199::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:02:54,201::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-04 21:02:54,204::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:02:54,206::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:02:54,208::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:02:54,211::__init__::225::IOProcess::(_processLogs) (844095) Finding callback 'access'... >Thread-14::DEBUG::2014-09-04 21:02:54,213::__init__::225::IOProcess::(_processLogs) (844095) Got request for method 'access' >Thread-14::DEBUG::2014-09-04 21:02:54,216::__init__::225::IOProcess::(_processLogs) (844095) Queuing response >Thread-14::DEBUG::2014-09-04 21:02:54,218::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:02:54,220::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-14::DEBUG::2014-09-04 21:02:54,229::__init__::225::IOProcess::(_processLogs) Message size is 187 >Thread-14::DEBUG::2014-09-04 21:02:54,231::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:02:54,234::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-04 21:02:54,236::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:02:54,238::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:02:54,241::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:02:54,243::__init__::225::IOProcess::(_processLogs) (844096) Finding callback 'access'... >Thread-14::DEBUG::2014-09-04 21:02:54,246::__init__::225::IOProcess::(_processLogs) (844096) Got request for method 'access' >Thread-14::DEBUG::2014-09-04 21:02:54,249::__init__::225::IOProcess::(_processLogs) (844096) Queuing response >Thread-14::DEBUG::2014-09-04 21:02:54,251::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:02:54,253::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-14::DEBUG::2014-09-04 21:02:54,261::__init__::225::IOProcess::(_processLogs) Message size is 189 >Thread-14::DEBUG::2014-09-04 21:02:54,264::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:02:54,266::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-04 21:02:54,269::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:02:54,272::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:02:54,274::__init__::225::IOProcess::(_processLogs) (844097) Finding callback 'access'... >Thread-14::DEBUG::2014-09-04 21:02:54,276::__init__::225::IOProcess::(_processLogs) (844097) Got request for method 'access' >Thread-14::DEBUG::2014-09-04 21:02:54,278::__init__::225::IOProcess::(_processLogs) (844097) Building response >Thread-14::DEBUG::2014-09-04 21:02:54,281::__init__::225::IOProcess::(_processLogs) (844097) Queuing response >Thread-14::DEBUG::2014-09-04 21:02:54,283::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:02:54,285::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-13916::DEBUG::2014-09-04 21:02:54,519::task::595::Storage.TaskManager.Task::(_updateState) Task=`abdcaf32-357f-4229-8a2b-8f0463dc7907`::moving from state init -> state preparing >Thread-13916::INFO::2014-09-04 21:02:54,519::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13916::INFO::2014-09-04 21:02:54,520::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180c43ee-5baf-41b7-87c7-c0214b51fe8f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000346023', 'lastCheck': '0.2', 'valid': True}, '7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000939394', 'lastCheck': '0.5', 'valid': True}, '7ad04229-b793-4f73-ad10-5e41a4e836ff': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000337884', 'lastCheck': '0.4', 'valid': True}} >Thread-13916::DEBUG::2014-09-04 21:02:54,520::task::1191::Storage.TaskManager.Task::(prepare) Task=`abdcaf32-357f-4229-8a2b-8f0463dc7907`::finished: {'180c43ee-5baf-41b7-87c7-c0214b51fe8f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000346023', 'lastCheck': '0.2', 'valid': True}, '7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000939394', 'lastCheck': '0.5', 'valid': True}, '7ad04229-b793-4f73-ad10-5e41a4e836ff': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000337884', 'lastCheck': '0.4', 'valid': True}} >Thread-13916::DEBUG::2014-09-04 21:02:54,520::task::595::Storage.TaskManager.Task::(_updateState) Task=`abdcaf32-357f-4229-8a2b-8f0463dc7907`::moving from state preparing -> state finished >Thread-13916::DEBUG::2014-09-04 21:02:54,520::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13916::DEBUG::2014-09-04 21:02:54,520::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13916::DEBUG::2014-09-04 21:02:54,520::task::993::Storage.TaskManager.Task::(_decref) Task=`abdcaf32-357f-4229-8a2b-8f0463dc7907`::ref 0 aborting False >Thread-13916::DEBUG::2014-09-04 21:02:54,542::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >Thread-13916::DEBUG::2014-09-04 21:02:54,543::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >Dummy-41::DEBUG::2014-09-04 21:02:56,434::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/78390355-2a2d-41e5-aea5-fb426559f747/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-41::DEBUG::2014-09-04 21:02:56,810::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0126526 s, 80.9 MB/s\n'; <rc> = 0 >Dummy-41::DEBUG::2014-09-04 21:02:58,822::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/78390355-2a2d-41e5-aea5-fb426559f747/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >GuestMonitor-numa__test::DEBUG::2014-09-04 21:02:59,325::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >GuestMonitor-quota__vm::DEBUG::2014-09-04 21:02:59,326::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >GuestMonitor-numa__test::DEBUG::2014-09-04 21:02:59,336::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >GuestMonitor-quota__vm::DEBUG::2014-09-04 21:02:59,341::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >GuestMonitor-numa__test::DEBUG::2014-09-04 21:02:59,345::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >GuestMonitor-quota__vm::DEBUG::2014-09-04 21:02:59,352::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >Dummy-41::DEBUG::2014-09-04 21:02:59,393::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.214018 s, 4.8 MB/s\n'; <rc> = 0 >Dummy-41::DEBUG::2014-09-04 21:03:01,405::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/78390355-2a2d-41e5-aea5-fb426559f747/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-41::DEBUG::2014-09-04 21:03:01,781::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0125 s, 81.9 MB/s\n'; <rc> = 0 >Dummy-41::DEBUG::2014-09-04 21:03:03,793::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/78390355-2a2d-41e5-aea5-fb426559f747/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >VM Channels Listener::DEBUG::2014-09-04 21:03:03,793::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-09-04 21:03:04,119::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 57. >Thread-14::DEBUG::2014-09-04 21:03:04,119::__init__::225::IOProcess::(_processLogs) Message size is 190 >Thread-14::DEBUG::2014-09-04 21:03:04,120::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:03:04,120::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-04 21:03:04,120::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:03:04,120::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:03:04,121::__init__::225::IOProcess::(_processLogs) (844098) Finding callback 'statvfs'... >Thread-14::DEBUG::2014-09-04 21:03:04,121::__init__::225::IOProcess::(_processLogs) (844098) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-04 21:03:04,122::__init__::225::IOProcess::(_processLogs) (844098) Queuing response >Thread-14::DEBUG::2014-09-04 21:03:04,123::__init__::225::IOProcess::(_processLogs) Sending response sized 329 >Thread-18::DEBUG::2014-09-04 21:03:04,128::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_qa_shared__iso__domain/7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-13916::DEBUG::2014-09-04 21:03:04,484::BindingXMLRPC::318::vds::(wrapper) client [10.35.163.104] >Thread-14::DEBUG::2014-09-04 21:03:04,486::__init__::225::IOProcess::(_processLogs) Message size is 147 >GuestMonitor-numa__test::DEBUG::2014-09-04 21:03:04,488::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >GuestMonitor-quota__vm::DEBUG::2014-09-04 21:03:04,494::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >Thread-14::DEBUG::2014-09-04 21:03:04,496::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-13916::DEBUG::2014-09-04 21:03:04,500::task::595::Storage.TaskManager.Task::(_updateState) Task=`f19315f1-792b-4df7-aa8a-66853849370a`::moving from state init -> state preparing >Thread-14::DEBUG::2014-09-04 21:03:04,505::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-13916::INFO::2014-09-04 21:03:04,509::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='78390355-2a2d-41e5-aea5-fb426559f747', options=None) >Thread-14::DEBUG::2014-09-04 21:03:04,516::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:03:04,525::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >GuestMonitor-numa__test::DEBUG::2014-09-04 21:03:04,526::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >Thread-18::DEBUG::2014-09-04 21:03:04,528::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1618 bytes (1.6 kB) copied, 0.00288421 s, 561 kB/s\n'; <rc> = 0 >Thread-13916::INFO::2014-09-04 21:03:04,532::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 8L}} >Thread-14::DEBUG::2014-09-04 21:03:04,534::__init__::225::IOProcess::(_processLogs) Extracting request information... >GuestMonitor-quota__vm::DEBUG::2014-09-04 21:03:04,541::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >Thread-14::DEBUG::2014-09-04 21:03:04,545::__init__::225::IOProcess::(_processLogs) (844099) Finding callback 'statvfs'... >Thread-13916::DEBUG::2014-09-04 21:03:04,544::task::1191::Storage.TaskManager.Task::(prepare) Task=`f19315f1-792b-4df7-aa8a-66853849370a`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 8L}} >Thread-14::DEBUG::2014-09-04 21:03:04,553::__init__::225::IOProcess::(_processLogs) (844099) Got request for method 'statvfs' >Thread-13916::DEBUG::2014-09-04 21:03:04,553::task::595::Storage.TaskManager.Task::(_updateState) Task=`f19315f1-792b-4df7-aa8a-66853849370a`::moving from state preparing -> state finished >GuestMonitor-numa__test::DEBUG::2014-09-04 21:03:04,559::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >Thread-13916::DEBUG::2014-09-04 21:03:04,562::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-09-04 21:03:04,563::__init__::225::IOProcess::(_processLogs) (844099) Building response >Thread-13916::DEBUG::2014-09-04 21:03:04,569::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-09-04 21:03:04,574::__init__::225::IOProcess::(_processLogs) (844099) Queuing response >GuestMonitor-quota__vm::DEBUG::2014-09-04 21:03:04,578::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >Thread-13916::DEBUG::2014-09-04 21:03:04,579::task::993::Storage.TaskManager.Task::(_decref) Task=`f19315f1-792b-4df7-aa8a-66853849370a`::ref 0 aborting False >Thread-14::DEBUG::2014-09-04 21:03:04,584::__init__::225::IOProcess::(_processLogs) Generating json... >Dummy-41::DEBUG::2014-09-04 21:03:04,642::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.479745 s, 2.1 MB/s\n'; <rc> = 0 >Thread-43::DEBUG::2014-09-04 21:03:04,645::BindingXMLRPC::318::vds::(wrapper) client [10.35.163.104] >Thread-14::DEBUG::2014-09-04 21:03:04,650::__init__::225::IOProcess::(_processLogs) Message size is 166 >Thread-10379::DEBUG::2014-09-04 21:03:04,653::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mavital/7ad04229-b793-4f73-ad10-5e41a4e836ff/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-43::DEBUG::2014-09-04 21:03:04,654::task::595::Storage.TaskManager.Task::(_updateState) Task=`f8f6028e-38f6-42e2-bda6-0c012d44cfb1`::moving from state init -> state preparing >Thread-14::DEBUG::2014-09-04 21:03:04,656::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-43::INFO::2014-09-04 21:03:04,979::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='78390355-2a2d-41e5-aea5-fb426559f747', options=None) >Thread-14::DEBUG::2014-09-04 21:03:04,981::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-10379::DEBUG::2014-09-04 21:03:04,986::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n339 bytes (339 B) copied, 0.000332016 s, 1.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-04 21:03:05,156::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:03:05,164::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-43::DEBUG::2014-09-04 21:03:05,165::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.78390355-2a2d-41e5-aea5-fb426559f747`ReqID=`1d686e3b-d055-471b-9337-7f1e0fcf7e93`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-43::DEBUG::2014-09-04 21:03:05,168::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.78390355-2a2d-41e5-aea5-fb426559f747' for lock type 'shared' >Thread-14::DEBUG::2014-09-04 21:03:05,168::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:03:05,173::__init__::225::IOProcess::(_processLogs) (844100) Finding callback 'statvfs'... >Thread-43::DEBUG::2014-09-04 21:03:05,174::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.78390355-2a2d-41e5-aea5-fb426559f747' is free. Now locking as 'shared' (1 active user) >Thread-14::DEBUG::2014-09-04 21:03:05,177::__init__::225::IOProcess::(_processLogs) (844100) Got request for method 'statvfs' >Thread-43::DEBUG::2014-09-04 21:03:05,177::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.78390355-2a2d-41e5-aea5-fb426559f747`ReqID=`1d686e3b-d055-471b-9337-7f1e0fcf7e93`::Granted request >Thread-14::DEBUG::2014-09-04 21:03:05,181::__init__::225::IOProcess::(_processLogs) (844100) Queuing response >Thread-14::DEBUG::2014-09-04 21:03:05,185::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-43::DEBUG::2014-09-04 21:03:05,186::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`f8f6028e-38f6-42e2-bda6-0c012d44cfb1`::_resourcesAcquired: Storage.78390355-2a2d-41e5-aea5-fb426559f747 (shared) >Thread-14::DEBUG::2014-09-04 21:03:05,189::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-43::DEBUG::2014-09-04 21:03:05,190::task::993::Storage.TaskManager.Task::(_decref) Task=`f8f6028e-38f6-42e2-bda6-0c012d44cfb1`::ref 1 aborting False >Thread-14::DEBUG::2014-09-04 21:03:05,209::__init__::225::IOProcess::(_processLogs) Message size is 190 >Thread-17::DEBUG::2014-09-04 21:03:05,213::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_artyom__storage__rhevm__35/180c43ee-5baf-41b7-87c7-c0214b51fe8f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-14::DEBUG::2014-09-04 21:03:05,214::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:03:05,744::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-04 21:03:05,753::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-17::DEBUG::2014-09-04 21:03:05,754::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n474 bytes (474 B) copied, 0.000342302 s, 1.4 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-04 21:03:05,761::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:03:05,766::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:03:05,773::__init__::225::IOProcess::(_processLogs) (844101) Finding callback 'statvfs'... >Thread-14::DEBUG::2014-09-04 21:03:05,777::__init__::225::IOProcess::(_processLogs) (844101) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-04 21:03:05,783::__init__::225::IOProcess::(_processLogs) (844101) Queuing response >Thread-14::DEBUG::2014-09-04 21:03:05,787::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:03:05,791::__init__::225::IOProcess::(_processLogs) Sending response sized 329 >Thread-14::DEBUG::2014-09-04 21:03:05,810::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-14::DEBUG::2014-09-04 21:03:05,816::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:03:05,819::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-04 21:03:05,822::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:03:05,825::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:03:05,828::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:03:05,831::__init__::225::IOProcess::(_processLogs) (844102) Finding callback 'statvfs'... >Thread-14::DEBUG::2014-09-04 21:03:05,833::__init__::225::IOProcess::(_processLogs) (844102) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-04 21:03:05,836::__init__::225::IOProcess::(_processLogs) (844102) Queuing response >Thread-14::DEBUG::2014-09-04 21:03:05,838::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:03:05,842::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-14::DEBUG::2014-09-04 21:03:05,856::__init__::225::IOProcess::(_processLogs) Message size is 166 >Thread-43::INFO::2014-09-04 21:03:05,862::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': u'/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_qa_shared__iso__domain/7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 8L, 'domains': '180c43ee-5baf-41b7-87c7-c0214b51fe8f:Active,7ad04229-b793-4f73-ad10-5e41a4e836ff:Active,7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6:Active', 'master_uuid': u'180c43ee-5baf-41b7-87c7-c0214b51fe8f', 'version': '3', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'180c43ee-5baf-41b7-87c7-c0214b51fe8f': {'status': 'Active', 'diskfree': '1820606529536', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246104576', 'version': 3}, '7ad04229-b793-4f73-ad10-5e41a4e836ff': {'status': 'Active', 'diskfree': '1820606529536', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246104576', 'version': 0}, '7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6': {'status': 'Active', 'diskfree': '18881708032', 'isoprefix': u'/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_qa_shared__iso__domain/7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '652610633728', 'version': 0}}} >Thread-14::DEBUG::2014-09-04 21:03:05,862::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-43::DEBUG::2014-09-04 21:03:05,866::task::1191::Storage.TaskManager.Task::(prepare) Task=`f8f6028e-38f6-42e2-bda6-0c012d44cfb1`::finished: {'info': {'name': 'No Description', 'isoprefix': u'/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_qa_shared__iso__domain/7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 8L, 'domains': '180c43ee-5baf-41b7-87c7-c0214b51fe8f:Active,7ad04229-b793-4f73-ad10-5e41a4e836ff:Active,7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6:Active', 'master_uuid': u'180c43ee-5baf-41b7-87c7-c0214b51fe8f', 'version': '3', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'180c43ee-5baf-41b7-87c7-c0214b51fe8f': {'status': 'Active', 'diskfree': '1820606529536', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246104576', 'version': 3}, '7ad04229-b793-4f73-ad10-5e41a4e836ff': {'status': 'Active', 'diskfree': '1820606529536', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246104576', 'version': 0}, '7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6': {'status': 'Active', 'diskfree': '18881708032', 'isoprefix': u'/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_qa_shared__iso__domain/7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '652610633728', 'version': 0}}} >Thread-14::DEBUG::2014-09-04 21:03:05,866::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-43::DEBUG::2014-09-04 21:03:05,869::task::595::Storage.TaskManager.Task::(_updateState) Task=`f8f6028e-38f6-42e2-bda6-0c012d44cfb1`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-09-04 21:03:05,871::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-43::DEBUG::2014-09-04 21:03:05,872::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.78390355-2a2d-41e5-aea5-fb426559f747': < ResourceRef 'Storage.78390355-2a2d-41e5-aea5-fb426559f747', isValid: 'True' obj: 'None'>} >Thread-14::DEBUG::2014-09-04 21:03:05,875::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-43::DEBUG::2014-09-04 21:03:05,876::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-09-04 21:03:05,879::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-43::DEBUG::2014-09-04 21:03:05,882::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.78390355-2a2d-41e5-aea5-fb426559f747' >Thread-14::DEBUG::2014-09-04 21:03:05,883::__init__::225::IOProcess::(_processLogs) (844103) Finding callback 'statvfs'... >Thread-14::DEBUG::2014-09-04 21:03:05,888::__init__::225::IOProcess::(_processLogs) (844103) Got request for method 'statvfs' >Thread-43::DEBUG::2014-09-04 21:03:05,888::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.78390355-2a2d-41e5-aea5-fb426559f747' (0 active users) >Thread-14::DEBUG::2014-09-04 21:03:05,891::__init__::225::IOProcess::(_processLogs) (844103) Building response >Thread-43::DEBUG::2014-09-04 21:03:05,891::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.78390355-2a2d-41e5-aea5-fb426559f747' is free, finding out if anyone is waiting for it. >Thread-14::DEBUG::2014-09-04 21:03:05,895::__init__::225::IOProcess::(_processLogs) (844103) Queuing response >Thread-43::DEBUG::2014-09-04 21:03:05,895::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.78390355-2a2d-41e5-aea5-fb426559f747', Clearing records. >Thread-14::DEBUG::2014-09-04 21:03:05,899::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-43::DEBUG::2014-09-04 21:03:05,902::task::993::Storage.TaskManager.Task::(_decref) Task=`f8f6028e-38f6-42e2-bda6-0c012d44cfb1`::ref 0 aborting False >Thread-14::DEBUG::2014-09-04 21:03:05,903::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-14::DEBUG::2014-09-04 21:03:05,928::__init__::225::IOProcess::(_processLogs) Message size is 183 >Thread-14::DEBUG::2014-09-04 21:03:05,931::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:03:05,934::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-04 21:03:05,937::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:03:05,943::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:03:05,946::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:03:05,950::__init__::225::IOProcess::(_processLogs) (844104) Finding callback 'access'... >Thread-14::DEBUG::2014-09-04 21:03:05,953::__init__::225::IOProcess::(_processLogs) (844104) Building response >Thread-14::DEBUG::2014-09-04 21:03:05,956::__init__::225::IOProcess::(_processLogs) (844104) Queuing response >Thread-14::DEBUG::2014-09-04 21:03:05,959::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:03:05,962::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-14::DEBUG::2014-09-04 21:03:05,971::__init__::225::IOProcess::(_processLogs) Message size is 187 >Thread-14::DEBUG::2014-09-04 21:03:05,973::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:03:05,976::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-04 21:03:05,979::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:03:05,982::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:03:05,984::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:03:05,987::__init__::225::IOProcess::(_processLogs) (844105) Finding callback 'access'... >Thread-14::DEBUG::2014-09-04 21:03:05,990::__init__::225::IOProcess::(_processLogs) (844105) Got request for method 'access' >Thread-14::DEBUG::2014-09-04 21:03:05,993::__init__::225::IOProcess::(_processLogs) (844105) Building response >Thread-14::DEBUG::2014-09-04 21:03:05,996::__init__::225::IOProcess::(_processLogs) (844105) Queuing response >Thread-14::DEBUG::2014-09-04 21:03:05,999::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-14::DEBUG::2014-09-04 21:03:06,008::__init__::225::IOProcess::(_processLogs) Message size is 189 >Thread-14::DEBUG::2014-09-04 21:03:06,011::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:03:06,014::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-04 21:03:06,017::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:03:06,019::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:03:06,022::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:03:06,025::__init__::225::IOProcess::(_processLogs) (844106) Finding callback 'access'... >Thread-14::DEBUG::2014-09-04 21:03:06,028::__init__::225::IOProcess::(_processLogs) (844106) Got request for method 'access' >Thread-14::DEBUG::2014-09-04 21:03:06,031::__init__::225::IOProcess::(_processLogs) (844106) Building response >Thread-14::DEBUG::2014-09-04 21:03:06,034::__init__::225::IOProcess::(_processLogs) (844106) Queuing response >Thread-14::DEBUG::2014-09-04 21:03:06,037::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:03:06,040::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-41::DEBUG::2014-09-04 21:03:08,156::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/78390355-2a2d-41e5-aea5-fb426559f747/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-41::DEBUG::2014-09-04 21:03:08,535::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.012638 s, 81.0 MB/s\n'; <rc> = 0 >GuestMonitor-numa__test::DEBUG::2014-09-04 21:03:09,582::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >GuestMonitor-numa__test::DEBUG::2014-09-04 21:03:09,583::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >GuestMonitor-numa__test::DEBUG::2014-09-04 21:03:09,583::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >GuestMonitor-quota__vm::DEBUG::2014-09-04 21:03:09,605::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >GuestMonitor-quota__vm::DEBUG::2014-09-04 21:03:09,605::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >GuestMonitor-quota__vm::DEBUG::2014-09-04 21:03:09,606::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >Thread-13916::DEBUG::2014-09-04 21:03:09,634::task::595::Storage.TaskManager.Task::(_updateState) Task=`bc3cdce9-7b9a-47e1-9756-f8e8a231b42d`::moving from state init -> state preparing >Thread-13916::INFO::2014-09-04 21:03:09,634::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13916::INFO::2014-09-04 21:03:09,634::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180c43ee-5baf-41b7-87c7-c0214b51fe8f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000342302', 'lastCheck': '3.6', 'valid': True}, '7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00288421', 'lastCheck': '3.8', 'valid': True}, '7ad04229-b793-4f73-ad10-5e41a4e836ff': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000332016', 'lastCheck': '3.8', 'valid': True}} >Thread-13916::DEBUG::2014-09-04 21:03:09,634::task::1191::Storage.TaskManager.Task::(prepare) Task=`bc3cdce9-7b9a-47e1-9756-f8e8a231b42d`::finished: {'180c43ee-5baf-41b7-87c7-c0214b51fe8f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000342302', 'lastCheck': '3.6', 'valid': True}, '7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00288421', 'lastCheck': '3.8', 'valid': True}, '7ad04229-b793-4f73-ad10-5e41a4e836ff': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000332016', 'lastCheck': '3.8', 'valid': True}} >Thread-13916::DEBUG::2014-09-04 21:03:09,634::task::595::Storage.TaskManager.Task::(_updateState) Task=`bc3cdce9-7b9a-47e1-9756-f8e8a231b42d`::moving from state preparing -> state finished >Thread-13916::DEBUG::2014-09-04 21:03:09,635::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13916::DEBUG::2014-09-04 21:03:09,635::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13916::DEBUG::2014-09-04 21:03:09,635::task::993::Storage.TaskManager.Task::(_decref) Task=`bc3cdce9-7b9a-47e1-9756-f8e8a231b42d`::ref 0 aborting False >Thread-13916::DEBUG::2014-09-04 21:03:09,657::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >Thread-13916::DEBUG::2014-09-04 21:03:09,657::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >Dummy-41::DEBUG::2014-09-04 21:03:10,547::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/78390355-2a2d-41e5-aea5-fb426559f747/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-41::DEBUG::2014-09-04 21:03:10,923::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0211416 s, 48.4 MB/s\n'; <rc> = 0 >Dummy-41::DEBUG::2014-09-04 21:03:13,106::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/78390355-2a2d-41e5-aea5-fb426559f747/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-41::DEBUG::2014-09-04 21:03:13,486::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0124756 s, 82.1 MB/s\n'; <rc> = 0 >GuestMonitor-numa__test::DEBUG::2014-09-04 21:03:14,590::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >GuestMonitor-numa__test::DEBUG::2014-09-04 21:03:14,590::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >GuestMonitor-numa__test::DEBUG::2014-09-04 21:03:14,591::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >GuestMonitor-quota__vm::DEBUG::2014-09-04 21:03:14,612::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >GuestMonitor-quota__vm::DEBUG::2014-09-04 21:03:14,613::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >GuestMonitor-quota__vm::DEBUG::2014-09-04 21:03:14,614::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >Dummy-41::DEBUG::2014-09-04 21:03:15,499::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/78390355-2a2d-41e5-aea5-fb426559f747/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-14::DEBUG::2014-09-04 21:03:15,821::__init__::225::IOProcess::(_processLogs) Message size is 190 >Thread-14::DEBUG::2014-09-04 21:03:15,823::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:03:15,825::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-04 21:03:15,826::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:03:15,829::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:03:15,831::__init__::225::IOProcess::(_processLogs) (844107) Finding callback 'statvfs'... >Thread-14::DEBUG::2014-09-04 21:03:15,832::__init__::225::IOProcess::(_processLogs) (844107) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-04 21:03:15,833::__init__::225::IOProcess::(_processLogs) (844107) Building response >Thread-14::DEBUG::2014-09-04 21:03:15,834::__init__::225::IOProcess::(_processLogs) (844107) Queuing response >Thread-14::DEBUG::2014-09-04 21:03:15,835::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:03:15,836::__init__::225::IOProcess::(_processLogs) Sending response sized 329 >Thread-18::DEBUG::2014-09-04 21:03:15,840::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_qa_shared__iso__domain/7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-18::DEBUG::2014-09-04 21:03:16,166::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1581 bytes (1.6 kB) copied, 0.000912363 s, 1.7 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-04 21:03:16,166::__init__::225::IOProcess::(_processLogs) Message size is 166 >Thread-13916::DEBUG::2014-09-04 21:03:16,167::BindingXMLRPC::318::vds::(wrapper) client [10.35.163.104] >Thread-14::DEBUG::2014-09-04 21:03:16,172::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:03:16,178::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-13916::DEBUG::2014-09-04 21:03:16,177::task::595::Storage.TaskManager.Task::(_updateState) Task=`d83cba92-18c4-4b65-b6b2-d481352dbb1a`::moving from state init -> state preparing >Thread-14::DEBUG::2014-09-04 21:03:16,182::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-13916::INFO::2014-09-04 21:03:16,183::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='78390355-2a2d-41e5-aea5-fb426559f747', options=None) >Thread-14::DEBUG::2014-09-04 21:03:16,186::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:03:16,189::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:03:16,192::__init__::225::IOProcess::(_processLogs) (844108) Finding callback 'statvfs'... >Thread-14::DEBUG::2014-09-04 21:03:16,195::__init__::225::IOProcess::(_processLogs) (844108) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-04 21:03:16,197::__init__::225::IOProcess::(_processLogs) (844108) Queuing response >Thread-13916::INFO::2014-09-04 21:03:16,200::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 8L}} >Thread-14::DEBUG::2014-09-04 21:03:16,200::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:03:16,205::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-13916::DEBUG::2014-09-04 21:03:16,204::task::1191::Storage.TaskManager.Task::(prepare) Task=`d83cba92-18c4-4b65-b6b2-d481352dbb1a`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 8L}} >Thread-13916::DEBUG::2014-09-04 21:03:16,209::task::595::Storage.TaskManager.Task::(_updateState) Task=`d83cba92-18c4-4b65-b6b2-d481352dbb1a`::moving from state preparing -> state finished >Thread-13916::DEBUG::2014-09-04 21:03:16,248::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Dummy-41::DEBUG::2014-09-04 21:03:16,249::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.387753 s, 2.6 MB/s\n'; <rc> = 0 >Thread-13916::DEBUG::2014-09-04 21:03:16,252::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13916::DEBUG::2014-09-04 21:03:16,257::task::993::Storage.TaskManager.Task::(_decref) Task=`d83cba92-18c4-4b65-b6b2-d481352dbb1a`::ref 0 aborting False >Thread-14::DEBUG::2014-09-04 21:03:16,258::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-17::DEBUG::2014-09-04 21:03:16,262::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_artyom__storage__rhevm__35/180c43ee-5baf-41b7-87c7-c0214b51fe8f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-14::DEBUG::2014-09-04 21:03:16,263::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:03:16,580::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-04 21:03:16,586::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-17::DEBUG::2014-09-04 21:03:16,587::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n474 bytes (474 B) copied, 0.000320955 s, 1.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-04 21:03:16,590::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:03:16,595::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:03:16,775::__init__::225::IOProcess::(_processLogs) (844109) Finding callback 'statvfs'... >Thread-14::DEBUG::2014-09-04 21:03:16,780::__init__::225::IOProcess::(_processLogs) (844109) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-04 21:03:16,786::__init__::225::IOProcess::(_processLogs) (844109) Queuing response >Thread-43::DEBUG::2014-09-04 21:03:16,786::BindingXMLRPC::318::vds::(wrapper) client [10.35.163.104] >Thread-14::DEBUG::2014-09-04 21:03:16,789::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:03:16,794::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-43::DEBUG::2014-09-04 21:03:16,795::task::595::Storage.TaskManager.Task::(_updateState) Task=`7066526b-02f8-475e-be1d-8a42a97a0bd0`::moving from state init -> state preparing >Thread-43::INFO::2014-09-04 21:03:16,802::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='78390355-2a2d-41e5-aea5-fb426559f747', options=None) >Thread-14::DEBUG::2014-09-04 21:03:16,814::__init__::225::IOProcess::(_processLogs) Message size is 190 >Thread-43::DEBUG::2014-09-04 21:03:16,818::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.78390355-2a2d-41e5-aea5-fb426559f747`ReqID=`e1ef9fcd-38a3-457d-bdff-1749a0dcd52f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10379::DEBUG::2014-09-04 21:03:16,821::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mavital/7ad04229-b793-4f73-ad10-5e41a4e836ff/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-14::DEBUG::2014-09-04 21:03:16,821::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-43::DEBUG::2014-09-04 21:03:16,824::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.78390355-2a2d-41e5-aea5-fb426559f747' for lock type 'shared' >Thread-14::DEBUG::2014-09-04 21:03:17,338::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-43::DEBUG::2014-09-04 21:03:17,351::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.78390355-2a2d-41e5-aea5-fb426559f747' is free. Now locking as 'shared' (1 active user) >Thread-10379::DEBUG::2014-09-04 21:03:17,352::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n339 bytes (339 B) copied, 0.000401955 s, 843 kB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-04 21:03:17,352::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-43::DEBUG::2014-09-04 21:03:17,358::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.78390355-2a2d-41e5-aea5-fb426559f747`ReqID=`e1ef9fcd-38a3-457d-bdff-1749a0dcd52f`::Granted request >Thread-14::DEBUG::2014-09-04 21:03:17,364::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:03:17,371::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-43::DEBUG::2014-09-04 21:03:17,374::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`7066526b-02f8-475e-be1d-8a42a97a0bd0`::_resourcesAcquired: Storage.78390355-2a2d-41e5-aea5-fb426559f747 (shared) >Thread-14::DEBUG::2014-09-04 21:03:17,378::__init__::225::IOProcess::(_processLogs) (844110) Finding callback 'statvfs'... >Thread-43::DEBUG::2014-09-04 21:03:17,380::task::993::Storage.TaskManager.Task::(_decref) Task=`7066526b-02f8-475e-be1d-8a42a97a0bd0`::ref 1 aborting False >Thread-14::DEBUG::2014-09-04 21:03:17,383::__init__::225::IOProcess::(_processLogs) (844110) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-04 21:03:17,391::__init__::225::IOProcess::(_processLogs) (844110) Queuing response >Thread-14::DEBUG::2014-09-04 21:03:17,397::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:03:17,403::__init__::225::IOProcess::(_processLogs) Sending response sized 329 >Thread-14::DEBUG::2014-09-04 21:03:17,432::__init__::225::IOProcess::(_processLogs) Message size is 166 >Thread-14::DEBUG::2014-09-04 21:03:17,440::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:03:17,446::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-04 21:03:17,452::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:03:17,457::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:03:17,463::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:03:17,467::__init__::225::IOProcess::(_processLogs) (844111) Finding callback 'statvfs'... >Thread-14::DEBUG::2014-09-04 21:03:17,471::__init__::225::IOProcess::(_processLogs) (844111) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-04 21:03:17,476::__init__::225::IOProcess::(_processLogs) (844111) Queuing response >Thread-14::DEBUG::2014-09-04 21:03:17,480::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:03:17,484::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-14::DEBUG::2014-09-04 21:03:17,499::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-14::DEBUG::2014-09-04 21:03:17,502::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:03:17,505::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-43::INFO::2014-09-04 21:03:17,508::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': u'/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_qa_shared__iso__domain/7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 8L, 'domains': '180c43ee-5baf-41b7-87c7-c0214b51fe8f:Active,7ad04229-b793-4f73-ad10-5e41a4e836ff:Active,7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6:Active', 'master_uuid': u'180c43ee-5baf-41b7-87c7-c0214b51fe8f', 'version': '3', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'180c43ee-5baf-41b7-87c7-c0214b51fe8f': {'status': 'Active', 'diskfree': '1820606464000', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246104576', 'version': 3}, '7ad04229-b793-4f73-ad10-5e41a4e836ff': {'status': 'Active', 'diskfree': '1820606464000', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246104576', 'version': 0}, '7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6': {'status': 'Active', 'diskfree': '18882756608', 'isoprefix': u'/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_qa_shared__iso__domain/7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '652611682304', 'version': 0}}} >Thread-14::DEBUG::2014-09-04 21:03:17,509::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-43::DEBUG::2014-09-04 21:03:17,512::task::1191::Storage.TaskManager.Task::(prepare) Task=`7066526b-02f8-475e-be1d-8a42a97a0bd0`::finished: {'info': {'name': 'No Description', 'isoprefix': u'/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_qa_shared__iso__domain/7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 8L, 'domains': '180c43ee-5baf-41b7-87c7-c0214b51fe8f:Active,7ad04229-b793-4f73-ad10-5e41a4e836ff:Active,7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6:Active', 'master_uuid': u'180c43ee-5baf-41b7-87c7-c0214b51fe8f', 'version': '3', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'180c43ee-5baf-41b7-87c7-c0214b51fe8f': {'status': 'Active', 'diskfree': '1820606464000', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246104576', 'version': 3}, '7ad04229-b793-4f73-ad10-5e41a4e836ff': {'status': 'Active', 'diskfree': '1820606464000', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246104576', 'version': 0}, '7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6': {'status': 'Active', 'diskfree': '18882756608', 'isoprefix': u'/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_qa_shared__iso__domain/7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '652611682304', 'version': 0}}} >Thread-14::DEBUG::2014-09-04 21:03:17,513::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-43::DEBUG::2014-09-04 21:03:17,515::task::595::Storage.TaskManager.Task::(_updateState) Task=`7066526b-02f8-475e-be1d-8a42a97a0bd0`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-09-04 21:03:17,516::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-43::DEBUG::2014-09-04 21:03:17,519::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.78390355-2a2d-41e5-aea5-fb426559f747': < ResourceRef 'Storage.78390355-2a2d-41e5-aea5-fb426559f747', isValid: 'True' obj: 'None'>} >Thread-14::DEBUG::2014-09-04 21:03:17,520::__init__::225::IOProcess::(_processLogs) (844112) Finding callback 'statvfs'... >Thread-43::DEBUG::2014-09-04 21:03:17,522::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-09-04 21:03:17,524::__init__::225::IOProcess::(_processLogs) (844112) Got request for method 'statvfs' >Thread-43::DEBUG::2014-09-04 21:03:17,528::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.78390355-2a2d-41e5-aea5-fb426559f747' >Thread-14::DEBUG::2014-09-04 21:03:17,528::__init__::225::IOProcess::(_processLogs) (844112) Queuing response >Thread-14::DEBUG::2014-09-04 21:03:17,532::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-43::DEBUG::2014-09-04 21:03:17,532::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.78390355-2a2d-41e5-aea5-fb426559f747' (0 active users) >Thread-43::DEBUG::2014-09-04 21:03:17,535::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.78390355-2a2d-41e5-aea5-fb426559f747' is free, finding out if anyone is waiting for it. >Thread-14::DEBUG::2014-09-04 21:03:17,535::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-43::DEBUG::2014-09-04 21:03:17,537::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.78390355-2a2d-41e5-aea5-fb426559f747', Clearing records. >Thread-43::DEBUG::2014-09-04 21:03:17,543::task::993::Storage.TaskManager.Task::(_decref) Task=`7066526b-02f8-475e-be1d-8a42a97a0bd0`::ref 0 aborting False >Thread-14::DEBUG::2014-09-04 21:03:17,552::__init__::225::IOProcess::(_processLogs) Message size is 183 >Thread-14::DEBUG::2014-09-04 21:03:17,557::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:03:17,562::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-04 21:03:17,565::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:03:17,568::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:03:17,569::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:03:17,571::__init__::225::IOProcess::(_processLogs) (844113) Finding callback 'access'... >Thread-14::DEBUG::2014-09-04 21:03:17,573::__init__::225::IOProcess::(_processLogs) (844113) Got request for method 'access' >Thread-14::DEBUG::2014-09-04 21:03:17,575::__init__::225::IOProcess::(_processLogs) (844113) Queuing response >Thread-14::DEBUG::2014-09-04 21:03:17,577::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:03:17,579::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-14::DEBUG::2014-09-04 21:03:17,587::__init__::225::IOProcess::(_processLogs) Message size is 187 >Thread-14::DEBUG::2014-09-04 21:03:17,590::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:03:17,592::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-04 21:03:17,595::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:03:17,597::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:03:17,600::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:03:17,603::__init__::225::IOProcess::(_processLogs) (844114) Finding callback 'access'... >Thread-14::DEBUG::2014-09-04 21:03:17,606::__init__::225::IOProcess::(_processLogs) (844114) Got request for method 'access' >Thread-14::DEBUG::2014-09-04 21:03:17,610::__init__::225::IOProcess::(_processLogs) (844114) Queuing response >Thread-14::DEBUG::2014-09-04 21:03:17,613::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:03:17,616::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-14::DEBUG::2014-09-04 21:03:17,626::__init__::225::IOProcess::(_processLogs) Message size is 189 >Thread-14::DEBUG::2014-09-04 21:03:17,628::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:03:17,631::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-04 21:03:17,634::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:03:17,637::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:03:17,639::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:03:17,642::__init__::225::IOProcess::(_processLogs) (844115) Finding callback 'access'... >Thread-14::DEBUG::2014-09-04 21:03:17,645::__init__::225::IOProcess::(_processLogs) (844115) Got request for method 'access' >Thread-14::DEBUG::2014-09-04 21:03:17,648::__init__::225::IOProcess::(_processLogs) (844115) Building response >Thread-14::DEBUG::2014-09-04 21:03:17,651::__init__::225::IOProcess::(_processLogs) (844115) Queuing response >Thread-14::DEBUG::2014-09-04 21:03:17,654::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:03:17,657::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >GuestMonitor-numa__test::DEBUG::2014-09-04 21:03:19,597::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >GuestMonitor-numa__test::DEBUG::2014-09-04 21:03:19,598::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >GuestMonitor-numa__test::DEBUG::2014-09-04 21:03:19,599::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >GuestMonitor-quota__vm::DEBUG::2014-09-04 21:03:19,620::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >GuestMonitor-quota__vm::DEBUG::2014-09-04 21:03:19,621::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >GuestMonitor-quota__vm::DEBUG::2014-09-04 21:03:19,621::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >Dummy-41::DEBUG::2014-09-04 21:03:19,784::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/78390355-2a2d-41e5-aea5-fb426559f747/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-41::DEBUG::2014-09-04 21:03:20,144::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0125316 s, 81.7 MB/s\n'; <rc> = 0 >Dummy-41::DEBUG::2014-09-04 21:03:22,156::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/78390355-2a2d-41e5-aea5-fb426559f747/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-41::DEBUG::2014-09-04 21:03:22,524::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0128103 s, 79.9 MB/s\n'; <rc> = 0 >GuestMonitor-numa__test::DEBUG::2014-09-04 21:03:24,605::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >GuestMonitor-numa__test::DEBUG::2014-09-04 21:03:24,606::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >GuestMonitor-numa__test::DEBUG::2014-09-04 21:03:24,607::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >GuestMonitor-quota__vm::DEBUG::2014-09-04 21:03:24,628::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >GuestMonitor-quota__vm::DEBUG::2014-09-04 21:03:24,629::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >GuestMonitor-quota__vm::DEBUG::2014-09-04 21:03:24,629::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >Dummy-41::DEBUG::2014-09-04 21:03:24,705::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/78390355-2a2d-41e5-aea5-fb426559f747/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-13916::DEBUG::2014-09-04 21:03:25,039::task::595::Storage.TaskManager.Task::(_updateState) Task=`4d1bd151-a465-4c66-b1be-34bd5c982e64`::moving from state init -> state preparing >Thread-13916::INFO::2014-09-04 21:03:25,039::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13916::INFO::2014-09-04 21:03:25,039::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180c43ee-5baf-41b7-87c7-c0214b51fe8f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000320955', 'lastCheck': '7.4', 'valid': True}, '7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000912363', 'lastCheck': '7.6', 'valid': True}, '7ad04229-b793-4f73-ad10-5e41a4e836ff': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000401955', 'lastCheck': '7.5', 'valid': True}} >Thread-13916::DEBUG::2014-09-04 21:03:25,040::task::1191::Storage.TaskManager.Task::(prepare) Task=`4d1bd151-a465-4c66-b1be-34bd5c982e64`::finished: {'180c43ee-5baf-41b7-87c7-c0214b51fe8f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000320955', 'lastCheck': '7.4', 'valid': True}, '7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000912363', 'lastCheck': '7.6', 'valid': True}, '7ad04229-b793-4f73-ad10-5e41a4e836ff': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000401955', 'lastCheck': '7.5', 'valid': True}} >Thread-13916::DEBUG::2014-09-04 21:03:25,040::task::595::Storage.TaskManager.Task::(_updateState) Task=`4d1bd151-a465-4c66-b1be-34bd5c982e64`::moving from state preparing -> state finished >Thread-13916::DEBUG::2014-09-04 21:03:25,040::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13916::DEBUG::2014-09-04 21:03:25,040::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13916::DEBUG::2014-09-04 21:03:25,040::task::993::Storage.TaskManager.Task::(_decref) Task=`4d1bd151-a465-4c66-b1be-34bd5c982e64`::ref 0 aborting False >Dummy-41::DEBUG::2014-09-04 21:03:25,088::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0184092 s, 55.6 MB/s\n'; <rc> = 0 >Thread-13916::DEBUG::2014-09-04 21:03:25,092::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >Thread-13916::DEBUG::2014-09-04 21:03:25,095::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >Dummy-41::DEBUG::2014-09-04 21:03:27,119::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/78390355-2a2d-41e5-aea5-fb426559f747/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-14::DEBUG::2014-09-04 21:03:27,440::__init__::225::IOProcess::(_processLogs) Message size is 190 >Thread-14::DEBUG::2014-09-04 21:03:27,440::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:03:27,440::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:03:27,441::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:03:27,441::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:03:27,441::__init__::225::IOProcess::(_processLogs) (844116) Finding callback 'statvfs'... >Thread-14::DEBUG::2014-09-04 21:03:27,441::__init__::225::IOProcess::(_processLogs) (844116) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-04 21:03:27,441::__init__::225::IOProcess::(_processLogs) (844116) Queuing response >Thread-14::DEBUG::2014-09-04 21:03:27,441::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-09-04 21:03:27,442::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_qa_shared__iso__domain/7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-18::DEBUG::2014-09-04 21:03:27,783::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1581 bytes (1.6 kB) copied, 0.00109518 s, 1.4 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-04 21:03:27,784::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-13916::DEBUG::2014-09-04 21:03:27,785::BindingXMLRPC::318::vds::(wrapper) client [10.35.163.104] flowID [50bb3e95] >Thread-14::DEBUG::2014-09-04 21:03:27,791::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:03:27,796::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-13916::DEBUG::2014-09-04 21:03:27,796::task::595::Storage.TaskManager.Task::(_updateState) Task=`009fea54-4674-4b32-879a-26097867cff5`::moving from state init -> state preparing >Thread-14::DEBUG::2014-09-04 21:03:27,802::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-13916::INFO::2014-09-04 21:03:27,804::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='78390355-2a2d-41e5-aea5-fb426559f747', options=None) >Thread-14::DEBUG::2014-09-04 21:03:27,807::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:03:27,813::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:03:27,816::__init__::225::IOProcess::(_processLogs) (844117) Finding callback 'statvfs'... >Thread-14::DEBUG::2014-09-04 21:03:27,820::__init__::225::IOProcess::(_processLogs) (844117) Got request for method 'statvfs' >Thread-13916::INFO::2014-09-04 21:03:27,822::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 8L}} >Thread-14::DEBUG::2014-09-04 21:03:27,824::__init__::225::IOProcess::(_processLogs) (844117) Building response >Thread-13916::DEBUG::2014-09-04 21:03:27,828::task::1191::Storage.TaskManager.Task::(prepare) Task=`009fea54-4674-4b32-879a-26097867cff5`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 8L}} >Thread-14::DEBUG::2014-09-04 21:03:27,830::__init__::225::IOProcess::(_processLogs) (844117) Queuing response >Thread-13916::DEBUG::2014-09-04 21:03:27,833::task::595::Storage.TaskManager.Task::(_updateState) Task=`009fea54-4674-4b32-879a-26097867cff5`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-09-04 21:03:27,836::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-13916::DEBUG::2014-09-04 21:03:27,838::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-09-04 21:03:27,842::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-13916::DEBUG::2014-09-04 21:03:27,843::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13916::DEBUG::2014-09-04 21:03:27,850::task::993::Storage.TaskManager.Task::(_decref) Task=`009fea54-4674-4b32-879a-26097867cff5`::ref 0 aborting False >Thread-14::DEBUG::2014-09-04 21:03:27,869::__init__::225::IOProcess::(_processLogs) Message size is 166 >Thread-10379::DEBUG::2014-09-04 21:03:27,874::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mavital/7ad04229-b793-4f73-ad10-5e41a4e836ff/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-14::DEBUG::2014-09-04 21:03:27,875::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:03:28,212::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-10379::DEBUG::2014-09-04 21:03:28,223::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n339 bytes (339 B) copied, 0.000331008 s, 1.0 MB/s\n'; <rc> = 0 >Thread-43::DEBUG::2014-09-04 21:03:28,392::BindingXMLRPC::318::vds::(wrapper) client [10.35.163.104] flowID [50bb3e95] >Thread-14::DEBUG::2014-09-04 21:03:28,395::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:03:28,407::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-43::DEBUG::2014-09-04 21:03:28,410::task::595::Storage.TaskManager.Task::(_updateState) Task=`0e69de56-a0bb-4be5-9ef9-ab433b5e1250`::moving from state init -> state preparing >Thread-14::DEBUG::2014-09-04 21:03:28,414::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-43::INFO::2014-09-04 21:03:28,455::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='78390355-2a2d-41e5-aea5-fb426559f747', options=None) >Dummy-41::DEBUG::2014-09-04 21:03:28,459::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.969004 s, 1.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-04 21:03:28,459::__init__::225::IOProcess::(_processLogs) (844118) Finding callback 'statvfs'... >Thread-14::DEBUG::2014-09-04 21:03:28,468::__init__::225::IOProcess::(_processLogs) (844118) Got request for method 'statvfs' >Thread-43::DEBUG::2014-09-04 21:03:28,473::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.78390355-2a2d-41e5-aea5-fb426559f747`ReqID=`62787bd0-b2d2-464b-ab66-55865de8bc97`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-14::DEBUG::2014-09-04 21:03:28,474::__init__::225::IOProcess::(_processLogs) (844118) Building response >Thread-43::DEBUG::2014-09-04 21:03:28,477::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.78390355-2a2d-41e5-aea5-fb426559f747' for lock type 'shared' >Thread-14::DEBUG::2014-09-04 21:03:28,479::__init__::225::IOProcess::(_processLogs) (844118) Queuing response >Thread-43::DEBUG::2014-09-04 21:03:28,483::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.78390355-2a2d-41e5-aea5-fb426559f747' is free. Now locking as 'shared' (1 active user) >Thread-14::DEBUG::2014-09-04 21:03:28,483::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-43::DEBUG::2014-09-04 21:03:28,486::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.78390355-2a2d-41e5-aea5-fb426559f747`ReqID=`62787bd0-b2d2-464b-ab66-55865de8bc97`::Granted request >Thread-14::DEBUG::2014-09-04 21:03:28,487::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-43::DEBUG::2014-09-04 21:03:28,498::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`0e69de56-a0bb-4be5-9ef9-ab433b5e1250`::_resourcesAcquired: Storage.78390355-2a2d-41e5-aea5-fb426559f747 (shared) >Thread-43::DEBUG::2014-09-04 21:03:28,502::task::993::Storage.TaskManager.Task::(_decref) Task=`0e69de56-a0bb-4be5-9ef9-ab433b5e1250`::ref 1 aborting False >Thread-14::DEBUG::2014-09-04 21:03:28,510::__init__::225::IOProcess::(_processLogs) Message size is 190 >Thread-14::DEBUG::2014-09-04 21:03:28,515::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:03:28,519::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-04 21:03:28,524::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-17::DEBUG::2014-09-04 21:03:28,527::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_artyom__storage__rhevm__35/180c43ee-5baf-41b7-87c7-c0214b51fe8f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-14::DEBUG::2014-09-04 21:03:28,530::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:03:29,028::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:03:29,034::__init__::225::IOProcess::(_processLogs) (844119) Finding callback 'statvfs'... >Thread-17::DEBUG::2014-09-04 21:03:29,034::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n474 bytes (474 B) copied, 0.00036257 s, 1.3 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-04 21:03:29,040::__init__::225::IOProcess::(_processLogs) (844119) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-04 21:03:29,046::__init__::225::IOProcess::(_processLogs) (844119) Queuing response >Thread-14::DEBUG::2014-09-04 21:03:29,050::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:03:29,054::__init__::225::IOProcess::(_processLogs) Sending response sized 329 >Thread-14::DEBUG::2014-09-04 21:03:29,074::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-14::DEBUG::2014-09-04 21:03:29,079::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:03:29,083::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-04 21:03:29,087::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:03:29,091::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:03:29,095::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:03:29,098::__init__::225::IOProcess::(_processLogs) (844120) Finding callback 'statvfs'... >Thread-14::DEBUG::2014-09-04 21:03:29,102::__init__::225::IOProcess::(_processLogs) (844120) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-04 21:03:29,106::__init__::225::IOProcess::(_processLogs) (844120) Queuing response >Thread-43::INFO::2014-09-04 21:03:29,109::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': u'/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_qa_shared__iso__domain/7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 8L, 'domains': '180c43ee-5baf-41b7-87c7-c0214b51fe8f:Active,7ad04229-b793-4f73-ad10-5e41a4e836ff:Active,7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6:Active', 'master_uuid': u'180c43ee-5baf-41b7-87c7-c0214b51fe8f', 'version': '3', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'180c43ee-5baf-41b7-87c7-c0214b51fe8f': {'status': 'Active', 'diskfree': '1820606398464', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246104576', 'version': 3}, '7ad04229-b793-4f73-ad10-5e41a4e836ff': {'status': 'Active', 'diskfree': '1820606398464', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246104576', 'version': 0}, '7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6': {'status': 'Active', 'diskfree': '18882756608', 'isoprefix': u'/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_qa_shared__iso__domain/7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '652611682304', 'version': 0}}} >Thread-14::DEBUG::2014-09-04 21:03:29,110::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-43::DEBUG::2014-09-04 21:03:29,113::task::1191::Storage.TaskManager.Task::(prepare) Task=`0e69de56-a0bb-4be5-9ef9-ab433b5e1250`::finished: {'info': {'name': 'No Description', 'isoprefix': u'/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_qa_shared__iso__domain/7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 8L, 'domains': '180c43ee-5baf-41b7-87c7-c0214b51fe8f:Active,7ad04229-b793-4f73-ad10-5e41a4e836ff:Active,7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6:Active', 'master_uuid': u'180c43ee-5baf-41b7-87c7-c0214b51fe8f', 'version': '3', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'180c43ee-5baf-41b7-87c7-c0214b51fe8f': {'status': 'Active', 'diskfree': '1820606398464', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246104576', 'version': 3}, '7ad04229-b793-4f73-ad10-5e41a4e836ff': {'status': 'Active', 'diskfree': '1820606398464', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246104576', 'version': 0}, '7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6': {'status': 'Active', 'diskfree': '18882756608', 'isoprefix': u'/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_qa_shared__iso__domain/7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '652611682304', 'version': 0}}} >Thread-14::DEBUG::2014-09-04 21:03:29,114::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-43::DEBUG::2014-09-04 21:03:29,116::task::595::Storage.TaskManager.Task::(_updateState) Task=`0e69de56-a0bb-4be5-9ef9-ab433b5e1250`::moving from state preparing -> state finished >Thread-43::DEBUG::2014-09-04 21:03:29,119::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.78390355-2a2d-41e5-aea5-fb426559f747': < ResourceRef 'Storage.78390355-2a2d-41e5-aea5-fb426559f747', isValid: 'True' obj: 'None'>} >Thread-43::DEBUG::2014-09-04 21:03:29,122::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-43::DEBUG::2014-09-04 21:03:29,128::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.78390355-2a2d-41e5-aea5-fb426559f747' >Thread-14::DEBUG::2014-09-04 21:03:29,131::__init__::225::IOProcess::(_processLogs) Message size is 166 >Thread-43::DEBUG::2014-09-04 21:03:29,136::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.78390355-2a2d-41e5-aea5-fb426559f747' (0 active users) >Thread-14::DEBUG::2014-09-04 21:03:29,136::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-43::DEBUG::2014-09-04 21:03:29,138::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.78390355-2a2d-41e5-aea5-fb426559f747' is free, finding out if anyone is waiting for it. >Thread-14::DEBUG::2014-09-04 21:03:29,140::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-43::DEBUG::2014-09-04 21:03:29,141::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.78390355-2a2d-41e5-aea5-fb426559f747', Clearing records. >Thread-14::DEBUG::2014-09-04 21:03:29,144::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-43::DEBUG::2014-09-04 21:03:29,147::task::993::Storage.TaskManager.Task::(_decref) Task=`0e69de56-a0bb-4be5-9ef9-ab433b5e1250`::ref 0 aborting False >Thread-14::DEBUG::2014-09-04 21:03:29,148::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:03:29,152::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:03:29,156::__init__::225::IOProcess::(_processLogs) (844121) Finding callback 'statvfs'... >Thread-14::DEBUG::2014-09-04 21:03:29,160::__init__::225::IOProcess::(_processLogs) (844121) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-04 21:03:29,165::__init__::225::IOProcess::(_processLogs) (844121) Queuing response >Thread-14::DEBUG::2014-09-04 21:03:29,169::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:03:29,173::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-14::DEBUG::2014-09-04 21:03:29,192::__init__::225::IOProcess::(_processLogs) Message size is 183 >Thread-14::DEBUG::2014-09-04 21:03:29,195::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:03:29,198::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-04 21:03:29,200::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:03:29,203::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:03:29,206::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:03:29,209::__init__::225::IOProcess::(_processLogs) (844122) Finding callback 'access'... >Thread-14::DEBUG::2014-09-04 21:03:29,211::__init__::225::IOProcess::(_processLogs) (844122) Got request for method 'access' >Thread-14::DEBUG::2014-09-04 21:03:29,214::__init__::225::IOProcess::(_processLogs) (844122) Building response >Thread-14::DEBUG::2014-09-04 21:03:29,217::__init__::225::IOProcess::(_processLogs) (844122) Queuing response >Thread-14::DEBUG::2014-09-04 21:03:29,220::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-14::DEBUG::2014-09-04 21:03:29,229::__init__::225::IOProcess::(_processLogs) Message size is 187 >Thread-14::DEBUG::2014-09-04 21:03:29,233::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:03:29,236::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-04 21:03:29,239::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:03:29,242::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:03:29,245::__init__::225::IOProcess::(_processLogs) (844123) Finding callback 'access'... >Thread-14::DEBUG::2014-09-04 21:03:29,248::__init__::225::IOProcess::(_processLogs) (844123) Got request for method 'access' >Thread-14::DEBUG::2014-09-04 21:03:29,251::__init__::225::IOProcess::(_processLogs) (844123) Building response >Thread-14::DEBUG::2014-09-04 21:03:29,254::__init__::225::IOProcess::(_processLogs) (844123) Queuing response >Thread-14::DEBUG::2014-09-04 21:03:29,256::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:03:29,259::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-14::DEBUG::2014-09-04 21:03:29,270::__init__::225::IOProcess::(_processLogs) Message size is 189 >Thread-14::DEBUG::2014-09-04 21:03:29,273::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:03:29,276::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-04 21:03:29,279::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:03:29,283::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:03:29,286::__init__::225::IOProcess::(_processLogs) (844124) Finding callback 'access'... >Thread-14::DEBUG::2014-09-04 21:03:29,289::__init__::225::IOProcess::(_processLogs) (844124) Got request for method 'access' >Thread-14::DEBUG::2014-09-04 21:03:29,292::__init__::225::IOProcess::(_processLogs) (844124) Building response >Thread-14::DEBUG::2014-09-04 21:03:29,295::__init__::225::IOProcess::(_processLogs) (844124) Queuing response >Thread-14::DEBUG::2014-09-04 21:03:29,298::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:03:29,300::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >GuestMonitor-numa__test::DEBUG::2014-09-04 21:03:29,613::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >GuestMonitor-numa__test::DEBUG::2014-09-04 21:03:29,614::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >GuestMonitor-numa__test::DEBUG::2014-09-04 21:03:29,614::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >GuestMonitor-quota__vm::DEBUG::2014-09-04 21:03:29,636::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >GuestMonitor-quota__vm::DEBUG::2014-09-04 21:03:29,637::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >GuestMonitor-quota__vm::DEBUG::2014-09-04 21:03:29,637::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >Dummy-41::DEBUG::2014-09-04 21:03:31,431::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/78390355-2a2d-41e5-aea5-fb426559f747/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-41::DEBUG::2014-09-04 21:03:31,786::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0125307 s, 81.7 MB/s\n'; <rc> = 0 >Dummy-41::DEBUG::2014-09-04 21:03:33,798::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/78390355-2a2d-41e5-aea5-fb426559f747/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-41::DEBUG::2014-09-04 21:03:34,161::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0127202 s, 80.5 MB/s\n'; <rc> = 0 >GuestMonitor-numa__test::DEBUG::2014-09-04 21:03:34,720::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >GuestMonitor-quota__vm::DEBUG::2014-09-04 21:03:34,724::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >GuestMonitor-numa__test::DEBUG::2014-09-04 21:03:34,729::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >GuestMonitor-quota__vm::DEBUG::2014-09-04 21:03:34,731::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >GuestMonitor-numa__test::DEBUG::2014-09-04 21:03:34,733::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >GuestMonitor-quota__vm::DEBUG::2014-09-04 21:03:34,736::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >VM Channels Listener::DEBUG::2014-09-04 21:03:34,754::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-09-04 21:03:34,754::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 57. >Dummy-41::DEBUG::2014-09-04 21:03:36,173::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/78390355-2a2d-41e5-aea5-fb426559f747/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-41::DEBUG::2014-09-04 21:03:36,546::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0220222 s, 46.5 MB/s\n'; <rc> = 0 >Thread-9196::DEBUG::2014-09-04 21:03:38,496::task::595::Storage.TaskManager.Task::(_updateState) Task=`1ed69a24-7ecd-43e6-a24a-33a7346d9b08`::moving from state init -> state preparing >Thread-9196::INFO::2014-09-04 21:03:38,496::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='180c43ee-5baf-41b7-87c7-c0214b51fe8f', spUUID='78390355-2a2d-41e5-aea5-fb426559f747', imgUUID='e8bb0473-2d86-4f1c-9d82-2c9690c52427', volUUID='bed5a4ba-eae0-49bf-a6b2-be81e7c21100', options=None) >Thread-14::DEBUG::2014-09-04 21:03:38,499::__init__::225::IOProcess::(_processLogs) Message size is 244 >Thread-14::DEBUG::2014-09-04 21:03:38,499::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-04 21:03:38,499::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:03:38,500::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:03:38,500::__init__::225::IOProcess::(_processLogs) (844125) Finding callback 'stat'... >Thread-14::DEBUG::2014-09-04 21:03:38,500::__init__::225::IOProcess::(_processLogs) (844125) Got request for method 'stat' >Thread-14::DEBUG::2014-09-04 21:03:38,500::__init__::225::IOProcess::(_processLogs) (844125) Queuing response >Thread-14::DEBUG::2014-09-04 21:03:38,500::__init__::225::IOProcess::(_processLogs) Sending response sized 327 >Thread-14::DEBUG::2014-09-04 21:03:38,501::__init__::225::IOProcess::(_processLogs) Message size is 244 >Thread-14::DEBUG::2014-09-04 21:03:38,502::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:03:38,502::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:03:38,502::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:03:38,502::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:03:38,502::__init__::225::IOProcess::(_processLogs) (844126) Finding callback 'stat'... >Thread-14::DEBUG::2014-09-04 21:03:38,502::__init__::225::IOProcess::(_processLogs) (844126) Got request for method 'stat' >Thread-14::DEBUG::2014-09-04 21:03:38,502::__init__::225::IOProcess::(_processLogs) (844126) Building response >Thread-14::DEBUG::2014-09-04 21:03:38,503::__init__::225::IOProcess::(_processLogs) (844126) Queuing response >Thread-14::DEBUG::2014-09-04 21:03:38,503::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:03:38,503::__init__::225::IOProcess::(_processLogs) Sending response sized 327 >Thread-9196::INFO::2014-09-04 21:03:38,504::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '24576', 'apparentsize': '1073741824'} >Thread-9196::DEBUG::2014-09-04 21:03:38,504::task::1191::Storage.TaskManager.Task::(prepare) Task=`1ed69a24-7ecd-43e6-a24a-33a7346d9b08`::finished: {'truesize': '24576', 'apparentsize': '1073741824'} >Thread-9196::DEBUG::2014-09-04 21:03:38,504::task::595::Storage.TaskManager.Task::(_updateState) Task=`1ed69a24-7ecd-43e6-a24a-33a7346d9b08`::moving from state preparing -> state finished >Thread-9196::DEBUG::2014-09-04 21:03:38,504::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-9196::DEBUG::2014-09-04 21:03:38,504::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-9196::DEBUG::2014-09-04 21:03:38,504::task::993::Storage.TaskManager.Task::(_decref) Task=`1ed69a24-7ecd-43e6-a24a-33a7346d9b08`::ref 0 aborting False >Dummy-41::DEBUG::2014-09-04 21:03:38,559::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/78390355-2a2d-41e5-aea5-fb426559f747/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-41::DEBUG::2014-09-04 21:03:38,936::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0127015 s, 80.6 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-04 21:03:39,084::__init__::225::IOProcess::(_processLogs) Message size is 190 >Thread-14::DEBUG::2014-09-04 21:03:39,084::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:03:39,084::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:03:39,084::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:03:39,085::__init__::225::IOProcess::(_processLogs) (844127) Finding callback 'statvfs'... >Thread-14::DEBUG::2014-09-04 21:03:39,085::__init__::225::IOProcess::(_processLogs) (844127) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-04 21:03:39,089::__init__::225::IOProcess::(_processLogs) (844127) Queuing response >Thread-14::DEBUG::2014-09-04 21:03:39,089::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-18::DEBUG::2014-09-04 21:03:39,090::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_qa_shared__iso__domain/7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-13916::DEBUG::2014-09-04 21:03:39,428::BindingXMLRPC::318::vds::(wrapper) client [10.35.163.104] flowID [76fd6c85] >Thread-14::DEBUG::2014-09-04 21:03:39,429::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-09-04 21:03:39,430::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1618 bytes (1.6 kB) copied, 0.000948876 s, 1.7 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-04 21:03:39,434::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-13916::DEBUG::2014-09-04 21:03:39,436::task::595::Storage.TaskManager.Task::(_updateState) Task=`18967e4f-985f-4ae0-81f1-99f70ce26ccd`::moving from state init -> state preparing >Thread-14::DEBUG::2014-09-04 21:03:39,438::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-13916::INFO::2014-09-04 21:03:39,440::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='78390355-2a2d-41e5-aea5-fb426559f747', options=None) >Thread-14::DEBUG::2014-09-04 21:03:39,441::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:03:39,444::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:03:39,446::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:03:39,447::__init__::225::IOProcess::(_processLogs) (844128) Finding callback 'statvfs'... >Thread-14::DEBUG::2014-09-04 21:03:39,448::__init__::225::IOProcess::(_processLogs) (844128) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-04 21:03:39,449::__init__::225::IOProcess::(_processLogs) (844128) Queuing response >Thread-14::DEBUG::2014-09-04 21:03:39,450::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:03:39,451::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-13916::INFO::2014-09-04 21:03:39,456::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 8L}} >Thread-10379::DEBUG::2014-09-04 21:03:39,455::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mavital/7ad04229-b793-4f73-ad10-5e41a4e836ff/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-14::DEBUG::2014-09-04 21:03:39,456::__init__::225::IOProcess::(_processLogs) Message size is 166 >Thread-13916::DEBUG::2014-09-04 21:03:39,457::task::1191::Storage.TaskManager.Task::(prepare) Task=`18967e4f-985f-4ae0-81f1-99f70ce26ccd`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 8L}} >Thread-14::DEBUG::2014-09-04 21:03:39,793::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-13916::DEBUG::2014-09-04 21:03:39,796::task::595::Storage.TaskManager.Task::(_updateState) Task=`18967e4f-985f-4ae0-81f1-99f70ce26ccd`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-09-04 21:03:39,804::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-13916::DEBUG::2014-09-04 21:03:39,804::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10379::DEBUG::2014-09-04 21:03:39,805::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n339 bytes (339 B) copied, 0.00031317 s, 1.1 MB/s\n'; <rc> = 0 >GuestMonitor-quota__vm::DEBUG::2014-09-04 21:03:39,805::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >GuestMonitor-numa__test::DEBUG::2014-09-04 21:03:39,806::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >Thread-14::DEBUG::2014-09-04 21:03:39,809::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-13916::DEBUG::2014-09-04 21:03:39,809::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-09-04 21:03:39,816::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-13916::DEBUG::2014-09-04 21:03:39,818::task::993::Storage.TaskManager.Task::(_decref) Task=`18967e4f-985f-4ae0-81f1-99f70ce26ccd`::ref 0 aborting False >Thread-14::DEBUG::2014-09-04 21:03:39,823::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:03:39,829::__init__::225::IOProcess::(_processLogs) (844129) Finding callback 'statvfs'... >GuestMonitor-quota__vm::DEBUG::2014-09-04 21:03:39,834::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >GuestMonitor-numa__test::DEBUG::2014-09-04 21:03:39,834::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >Thread-14::DEBUG::2014-09-04 21:03:39,835::__init__::225::IOProcess::(_processLogs) (844129) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-04 21:03:39,841::__init__::225::IOProcess::(_processLogs) (844129) Queuing response >Thread-14::DEBUG::2014-09-04 21:03:39,845::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:03:39,851::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >GuestMonitor-quota__vm::DEBUG::2014-09-04 21:03:39,855::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >GuestMonitor-numa__test::DEBUG::2014-09-04 21:03:39,856::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >Thread-43::DEBUG::2014-09-04 21:03:39,856::BindingXMLRPC::318::vds::(wrapper) client [10.35.163.104] flowID [76fd6c85] >Thread-43::DEBUG::2014-09-04 21:03:39,867::task::595::Storage.TaskManager.Task::(_updateState) Task=`4afd1913-deaf-4f8d-afca-d67676ab0c17`::moving from state init -> state preparing >Thread-43::INFO::2014-09-04 21:03:39,873::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='78390355-2a2d-41e5-aea5-fb426559f747', options=None) >Thread-14::DEBUG::2014-09-04 21:03:39,875::__init__::225::IOProcess::(_processLogs) Message size is 190 >Thread-17::DEBUG::2014-09-04 21:03:39,878::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_artyom__storage__rhevm__35/180c43ee-5baf-41b7-87c7-c0214b51fe8f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-14::DEBUG::2014-09-04 21:03:39,879::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-43::DEBUG::2014-09-04 21:03:40,212::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.78390355-2a2d-41e5-aea5-fb426559f747`ReqID=`c6f0a7a6-e9b7-4b58-a224-ce95ad2cb01c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-14::DEBUG::2014-09-04 21:03:40,212::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-43::DEBUG::2014-09-04 21:03:40,394::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.78390355-2a2d-41e5-aea5-fb426559f747' for lock type 'shared' >Thread-17::DEBUG::2014-09-04 21:03:40,396::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n474 bytes (474 B) copied, 0.000302897 s, 1.6 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-04 21:03:40,398::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-43::DEBUG::2014-09-04 21:03:40,403::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.78390355-2a2d-41e5-aea5-fb426559f747' is free. Now locking as 'shared' (1 active user) >Thread-14::DEBUG::2014-09-04 21:03:40,404::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-43::DEBUG::2014-09-04 21:03:40,406::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.78390355-2a2d-41e5-aea5-fb426559f747`ReqID=`c6f0a7a6-e9b7-4b58-a224-ce95ad2cb01c`::Granted request >Thread-14::DEBUG::2014-09-04 21:03:40,407::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:03:40,410::__init__::225::IOProcess::(_processLogs) (844130) Finding callback 'statvfs'... >Thread-43::DEBUG::2014-09-04 21:03:40,413::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`4afd1913-deaf-4f8d-afca-d67676ab0c17`::_resourcesAcquired: Storage.78390355-2a2d-41e5-aea5-fb426559f747 (shared) >Thread-14::DEBUG::2014-09-04 21:03:40,413::__init__::225::IOProcess::(_processLogs) (844130) Got request for method 'statvfs' >Thread-43::DEBUG::2014-09-04 21:03:40,416::task::993::Storage.TaskManager.Task::(_decref) Task=`4afd1913-deaf-4f8d-afca-d67676ab0c17`::ref 1 aborting False >Thread-14::DEBUG::2014-09-04 21:03:40,418::__init__::225::IOProcess::(_processLogs) (844130) Queuing response >Thread-14::DEBUG::2014-09-04 21:03:40,421::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:03:40,425::__init__::225::IOProcess::(_processLogs) Sending response sized 329 >Thread-14::DEBUG::2014-09-04 21:03:40,441::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-14::DEBUG::2014-09-04 21:03:40,445::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:03:40,448::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-04 21:03:40,451::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:03:40,454::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:03:40,457::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:03:40,460::__init__::225::IOProcess::(_processLogs) (844131) Finding callback 'statvfs'... >Thread-14::DEBUG::2014-09-04 21:03:40,463::__init__::225::IOProcess::(_processLogs) (844131) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-04 21:03:40,466::__init__::225::IOProcess::(_processLogs) (844131) Queuing response >Thread-14::DEBUG::2014-09-04 21:03:40,469::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:03:40,472::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-14::DEBUG::2014-09-04 21:03:40,479::__init__::225::IOProcess::(_processLogs) Message size is 166 >Thread-14::DEBUG::2014-09-04 21:03:40,481::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:03:40,482::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-04 21:03:40,483::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:03:40,483::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:03:40,484::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:03:40,485::__init__::225::IOProcess::(_processLogs) (844132) Finding callback 'statvfs'... >Thread-14::DEBUG::2014-09-04 21:03:40,487::__init__::225::IOProcess::(_processLogs) (844132) Got request for method 'statvfs' >Thread-43::INFO::2014-09-04 21:03:40,489::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': u'/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_qa_shared__iso__domain/7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 8L, 'domains': '180c43ee-5baf-41b7-87c7-c0214b51fe8f:Active,7ad04229-b793-4f73-ad10-5e41a4e836ff:Active,7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6:Active', 'master_uuid': u'180c43ee-5baf-41b7-87c7-c0214b51fe8f', 'version': '3', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'180c43ee-5baf-41b7-87c7-c0214b51fe8f': {'status': 'Active', 'diskfree': '1820606398464', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246104576', 'version': 3}, '7ad04229-b793-4f73-ad10-5e41a4e836ff': {'status': 'Active', 'diskfree': '1820606398464', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246104576', 'version': 0}, '7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6': {'status': 'Active', 'diskfree': '18882756608', 'isoprefix': u'/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_qa_shared__iso__domain/7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '652611682304', 'version': 0}}} >Thread-14::DEBUG::2014-09-04 21:03:40,491::__init__::225::IOProcess::(_processLogs) (844132) Queuing response >Thread-43::DEBUG::2014-09-04 21:03:40,491::task::1191::Storage.TaskManager.Task::(prepare) Task=`4afd1913-deaf-4f8d-afca-d67676ab0c17`::finished: {'info': {'name': 'No Description', 'isoprefix': u'/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_qa_shared__iso__domain/7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 8L, 'domains': '180c43ee-5baf-41b7-87c7-c0214b51fe8f:Active,7ad04229-b793-4f73-ad10-5e41a4e836ff:Active,7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6:Active', 'master_uuid': u'180c43ee-5baf-41b7-87c7-c0214b51fe8f', 'version': '3', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'180c43ee-5baf-41b7-87c7-c0214b51fe8f': {'status': 'Active', 'diskfree': '1820606398464', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246104576', 'version': 3}, '7ad04229-b793-4f73-ad10-5e41a4e836ff': {'status': 'Active', 'diskfree': '1820606398464', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246104576', 'version': 0}, '7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6': {'status': 'Active', 'diskfree': '18882756608', 'isoprefix': u'/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_qa_shared__iso__domain/7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '652611682304', 'version': 0}}} >Thread-43::DEBUG::2014-09-04 21:03:40,494::task::595::Storage.TaskManager.Task::(_updateState) Task=`4afd1913-deaf-4f8d-afca-d67676ab0c17`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-09-04 21:03:40,493::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-43::DEBUG::2014-09-04 21:03:40,496::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.78390355-2a2d-41e5-aea5-fb426559f747': < ResourceRef 'Storage.78390355-2a2d-41e5-aea5-fb426559f747', isValid: 'True' obj: 'None'>} >Thread-14::DEBUG::2014-09-04 21:03:40,497::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-43::DEBUG::2014-09-04 21:03:40,498::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-43::DEBUG::2014-09-04 21:03:40,502::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.78390355-2a2d-41e5-aea5-fb426559f747' >Thread-43::DEBUG::2014-09-04 21:03:40,505::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.78390355-2a2d-41e5-aea5-fb426559f747' (0 active users) >Thread-43::DEBUG::2014-09-04 21:03:40,508::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.78390355-2a2d-41e5-aea5-fb426559f747' is free, finding out if anyone is waiting for it. >Thread-43::DEBUG::2014-09-04 21:03:40,510::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.78390355-2a2d-41e5-aea5-fb426559f747', Clearing records. >Thread-14::DEBUG::2014-09-04 21:03:40,513::__init__::225::IOProcess::(_processLogs) Message size is 183 >Thread-43::DEBUG::2014-09-04 21:03:40,516::task::993::Storage.TaskManager.Task::(_decref) Task=`4afd1913-deaf-4f8d-afca-d67676ab0c17`::ref 0 aborting False >Thread-14::DEBUG::2014-09-04 21:03:40,516::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:03:40,520::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-04 21:03:40,523::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:03:40,527::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:03:40,530::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:03:40,533::__init__::225::IOProcess::(_processLogs) (844133) Finding callback 'access'... >Thread-14::DEBUG::2014-09-04 21:03:40,535::__init__::225::IOProcess::(_processLogs) (844133) Got request for method 'access' >Thread-14::DEBUG::2014-09-04 21:03:40,536::__init__::225::IOProcess::(_processLogs) (844133) Building response >Thread-14::DEBUG::2014-09-04 21:03:40,537::__init__::225::IOProcess::(_processLogs) (844133) Queuing response >Thread-14::DEBUG::2014-09-04 21:03:40,538::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:03:40,539::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-14::DEBUG::2014-09-04 21:03:40,545::__init__::225::IOProcess::(_processLogs) Message size is 187 >Thread-14::DEBUG::2014-09-04 21:03:40,546::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:03:40,547::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-04 21:03:40,548::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:03:40,550::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:03:40,551::__init__::225::IOProcess::(_processLogs) (844134) Finding callback 'access'... >Thread-14::DEBUG::2014-09-04 21:03:40,552::__init__::225::IOProcess::(_processLogs) (844134) Got request for method 'access' >Thread-14::DEBUG::2014-09-04 21:03:40,553::__init__::225::IOProcess::(_processLogs) (844134) Building response >Thread-14::DEBUG::2014-09-04 21:03:40,554::__init__::225::IOProcess::(_processLogs) (844134) Queuing response >Thread-14::DEBUG::2014-09-04 21:03:40,555::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:03:40,556::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-14::DEBUG::2014-09-04 21:03:40,757::__init__::225::IOProcess::(_processLogs) Message size is 189 >Thread-14::DEBUG::2014-09-04 21:03:40,760::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:03:40,764::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-04 21:03:40,767::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:03:40,772::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:03:40,776::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:03:40,777::__init__::225::IOProcess::(_processLogs) (844135) Finding callback 'access'... >Thread-14::DEBUG::2014-09-04 21:03:40,780::__init__::225::IOProcess::(_processLogs) (844135) Got request for method 'access' >Thread-14::DEBUG::2014-09-04 21:03:40,786::__init__::225::IOProcess::(_processLogs) (844135) Building response >Thread-14::DEBUG::2014-09-04 21:03:40,794::__init__::225::IOProcess::(_processLogs) (844135) Queuing response >Thread-14::DEBUG::2014-09-04 21:03:40,800::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:03:40,806::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-13916::DEBUG::2014-09-04 21:03:40,815::task::595::Storage.TaskManager.Task::(_updateState) Task=`7041e704-623c-4051-884a-943893e202ed`::moving from state init -> state preparing >Thread-13916::INFO::2014-09-04 21:03:40,821::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13916::INFO::2014-09-04 21:03:40,824::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180c43ee-5baf-41b7-87c7-c0214b51fe8f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000302897', 'lastCheck': '0.0', 'valid': True}, '7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000948876', 'lastCheck': '0.4', 'valid': True}, '7ad04229-b793-4f73-ad10-5e41a4e836ff': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00031317', 'lastCheck': '0.3', 'valid': True}} >Thread-13916::DEBUG::2014-09-04 21:03:40,828::task::1191::Storage.TaskManager.Task::(prepare) Task=`7041e704-623c-4051-884a-943893e202ed`::finished: {'180c43ee-5baf-41b7-87c7-c0214b51fe8f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000302897', 'lastCheck': '0.0', 'valid': True}, '7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000948876', 'lastCheck': '0.4', 'valid': True}, '7ad04229-b793-4f73-ad10-5e41a4e836ff': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00031317', 'lastCheck': '0.3', 'valid': True}} >Thread-13916::DEBUG::2014-09-04 21:03:40,832::task::595::Storage.TaskManager.Task::(_updateState) Task=`7041e704-623c-4051-884a-943893e202ed`::moving from state preparing -> state finished >Thread-13916::DEBUG::2014-09-04 21:03:40,833::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13916::DEBUG::2014-09-04 21:03:40,834::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13916::DEBUG::2014-09-04 21:03:40,837::task::993::Storage.TaskManager.Task::(_decref) Task=`7041e704-623c-4051-884a-943893e202ed`::ref 0 aborting False >Thread-13916::DEBUG::2014-09-04 21:03:40,896::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >Thread-13916::DEBUG::2014-09-04 21:03:40,902::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >Dummy-41::DEBUG::2014-09-04 21:03:40,947::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/78390355-2a2d-41e5-aea5-fb426559f747/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-41::DEBUG::2014-09-04 21:03:41,311::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0127488 s, 80.3 MB/s\n'; <rc> = 0 >Dummy-41::DEBUG::2014-09-04 21:03:43,323::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/78390355-2a2d-41e5-aea5-fb426559f747/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-41::DEBUG::2014-09-04 21:03:43,688::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.012788 s, 80.1 MB/s\n'; <rc> = 0 >Thread-9209::DEBUG::2014-09-04 21:03:43,811::task::595::Storage.TaskManager.Task::(_updateState) Task=`0adf39dd-2712-431c-b0b9-1e11a90c7c53`::moving from state init -> state preparing >Thread-9209::INFO::2014-09-04 21:03:43,811::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='180c43ee-5baf-41b7-87c7-c0214b51fe8f', spUUID='78390355-2a2d-41e5-aea5-fb426559f747', imgUUID='70069763-69d2-42a9-86e7-23db8019e0b3', volUUID='0f679bfe-49c1-4e90-b02a-4f075a42fda5', options=None) >Thread-14::DEBUG::2014-09-04 21:03:43,812::__init__::225::IOProcess::(_processLogs) Message size is 244 >Thread-14::DEBUG::2014-09-04 21:03:43,812::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:03:43,813::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-04 21:03:43,813::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:03:43,813::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:03:43,813::__init__::225::IOProcess::(_processLogs) (844136) Finding callback 'stat'... >Thread-14::DEBUG::2014-09-04 21:03:43,813::__init__::225::IOProcess::(_processLogs) (844136) Got request for method 'stat' >Thread-14::DEBUG::2014-09-04 21:03:43,813::__init__::225::IOProcess::(_processLogs) (844136) Queuing response >Thread-14::DEBUG::2014-09-04 21:03:43,813::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:03:43,813::__init__::225::IOProcess::(_processLogs) Sending response sized 327 >Thread-14::DEBUG::2014-09-04 21:03:43,815::__init__::225::IOProcess::(_processLogs) Message size is 244 >Thread-14::DEBUG::2014-09-04 21:03:43,815::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:03:43,815::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:03:43,815::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:03:43,815::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:03:43,815::__init__::225::IOProcess::(_processLogs) (844137) Finding callback 'stat'... >Thread-14::DEBUG::2014-09-04 21:03:43,815::__init__::225::IOProcess::(_processLogs) (844137) Got request for method 'stat' >Thread-14::DEBUG::2014-09-04 21:03:43,815::__init__::225::IOProcess::(_processLogs) (844137) Building response >Thread-14::DEBUG::2014-09-04 21:03:43,816::__init__::225::IOProcess::(_processLogs) (844137) Queuing response >Thread-14::DEBUG::2014-09-04 21:03:43,816::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:03:43,816::__init__::225::IOProcess::(_processLogs) Sending response sized 327 >Thread-9209::INFO::2014-09-04 21:03:43,816::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '24576', 'apparentsize': '1073741824'} >Thread-9209::DEBUG::2014-09-04 21:03:43,817::task::1191::Storage.TaskManager.Task::(prepare) Task=`0adf39dd-2712-431c-b0b9-1e11a90c7c53`::finished: {'truesize': '24576', 'apparentsize': '1073741824'} >Thread-9209::DEBUG::2014-09-04 21:03:43,817::task::595::Storage.TaskManager.Task::(_updateState) Task=`0adf39dd-2712-431c-b0b9-1e11a90c7c53`::moving from state preparing -> state finished >Thread-9209::DEBUG::2014-09-04 21:03:43,817::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-9209::DEBUG::2014-09-04 21:03:43,817::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-9209::DEBUG::2014-09-04 21:03:43,817::task::993::Storage.TaskManager.Task::(_decref) Task=`0adf39dd-2712-431c-b0b9-1e11a90c7c53`::ref 0 aborting False >GuestMonitor-quota__vm::DEBUG::2014-09-04 21:03:44,877::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >GuestMonitor-numa__test::DEBUG::2014-09-04 21:03:44,880::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >GuestMonitor-quota__vm::DEBUG::2014-09-04 21:03:44,884::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >GuestMonitor-numa__test::DEBUG::2014-09-04 21:03:44,885::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >GuestMonitor-quota__vm::DEBUG::2014-09-04 21:03:44,889::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >GuestMonitor-numa__test::DEBUG::2014-09-04 21:03:44,890::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >Dummy-41::DEBUG::2014-09-04 21:03:45,700::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/78390355-2a2d-41e5-aea5-fb426559f747/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-41::DEBUG::2014-09-04 21:03:46,225::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.174705 s, 5.9 MB/s\n'; <rc> = 0 >Dummy-41::DEBUG::2014-09-04 21:03:48,246::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/78390355-2a2d-41e5-aea5-fb426559f747/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-41::DEBUG::2014-09-04 21:03:48,625::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0128056 s, 80.0 MB/s\n'; <rc> = 0 >GuestMonitor-quota__vm::DEBUG::2014-09-04 21:03:49,904::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >GuestMonitor-numa__test::DEBUG::2014-09-04 21:03:49,904::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >GuestMonitor-numa__test::DEBUG::2014-09-04 21:03:49,909::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >GuestMonitor-quota__vm::DEBUG::2014-09-04 21:03:49,909::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >GuestMonitor-numa__test::DEBUG::2014-09-04 21:03:49,914::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >GuestMonitor-quota__vm::DEBUG::2014-09-04 21:03:49,915::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >Thread-14::DEBUG::2014-09-04 21:03:50,468::__init__::225::IOProcess::(_processLogs) Message size is 190 >Thread-14::DEBUG::2014-09-04 21:03:50,468::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:03:50,469::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:03:50,469::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:03:50,469::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:03:50,469::__init__::225::IOProcess::(_processLogs) (844138) Finding callback 'statvfs'... >Thread-14::DEBUG::2014-09-04 21:03:50,469::__init__::225::IOProcess::(_processLogs) (844138) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-04 21:03:50,469::__init__::225::IOProcess::(_processLogs) (844138) Queuing response >Thread-14::DEBUG::2014-09-04 21:03:50,469::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:03:50,470::__init__::225::IOProcess::(_processLogs) Sending response sized 329 >Thread-18::DEBUG::2014-09-04 21:03:50,470::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_qa_shared__iso__domain/7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Dummy-41::DEBUG::2014-09-04 21:03:50,790::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/78390355-2a2d-41e5-aea5-fb426559f747/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-14::DEBUG::2014-09-04 21:03:50,794::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-13916::DEBUG::2014-09-04 21:03:51,127::BindingXMLRPC::318::vds::(wrapper) client [10.35.163.104] flowID [45010d98] >Thread-18::DEBUG::2014-09-04 21:03:51,135::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1618 bytes (1.6 kB) copied, 0.00106782 s, 1.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-04 21:03:51,147::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-13916::DEBUG::2014-09-04 21:03:51,156::task::595::Storage.TaskManager.Task::(_updateState) Task=`f50093eb-16e2-4ed8-a4ad-6f836ee105f6`::moving from state init -> state preparing >Thread-14::DEBUG::2014-09-04 21:03:51,157::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-13916::INFO::2014-09-04 21:03:51,162::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='78390355-2a2d-41e5-aea5-fb426559f747', options=None) >Thread-14::DEBUG::2014-09-04 21:03:51,163::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:03:51,170::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:03:51,174::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:03:51,179::__init__::225::IOProcess::(_processLogs) (844139) Finding callback 'statvfs'... >Thread-13916::INFO::2014-09-04 21:03:51,181::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 8L}} >Thread-14::DEBUG::2014-09-04 21:03:51,184::__init__::225::IOProcess::(_processLogs) (844139) Got request for method 'statvfs' >Thread-13916::DEBUG::2014-09-04 21:03:51,187::task::1191::Storage.TaskManager.Task::(prepare) Task=`f50093eb-16e2-4ed8-a4ad-6f836ee105f6`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 8L}} >Thread-14::DEBUG::2014-09-04 21:03:51,190::__init__::225::IOProcess::(_processLogs) (844139) Building response >Thread-13916::DEBUG::2014-09-04 21:03:51,192::task::595::Storage.TaskManager.Task::(_updateState) Task=`f50093eb-16e2-4ed8-a4ad-6f836ee105f6`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-09-04 21:03:51,196::__init__::225::IOProcess::(_processLogs) (844139) Queuing response >Thread-13916::DEBUG::2014-09-04 21:03:51,197::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13916::DEBUG::2014-09-04 21:03:51,203::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-09-04 21:03:51,204::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-13916::DEBUG::2014-09-04 21:03:51,209::task::993::Storage.TaskManager.Task::(_decref) Task=`f50093eb-16e2-4ed8-a4ad-6f836ee105f6`::ref 0 aborting False >Thread-14::DEBUG::2014-09-04 21:03:51,233::__init__::225::IOProcess::(_processLogs) Message size is 166 >Thread-14::DEBUG::2014-09-04 21:03:51,237::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-10379::DEBUG::2014-09-04 21:03:51,236::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mavital/7ad04229-b793-4f73-ad10-5e41a4e836ff/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-14::DEBUG::2014-09-04 21:03:51,574::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-04 21:03:51,585::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-10379::DEBUG::2014-09-04 21:03:51,589::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n339 bytes (339 B) copied, 0.000276498 s, 1.2 MB/s\n'; <rc> = 0 >Thread-43::DEBUG::2014-09-04 21:03:51,590::BindingXMLRPC::318::vds::(wrapper) client [10.35.163.104] flowID [45010d98] >Thread-14::DEBUG::2014-09-04 21:03:51,593::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:03:51,599::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-43::DEBUG::2014-09-04 21:03:51,601::task::595::Storage.TaskManager.Task::(_updateState) Task=`6972389f-0b03-4d81-ae42-57dd660a79ad`::moving from state init -> state preparing >Thread-14::DEBUG::2014-09-04 21:03:51,603::__init__::225::IOProcess::(_processLogs) (844140) Finding callback 'statvfs'... >Thread-43::INFO::2014-09-04 21:03:51,605::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='78390355-2a2d-41e5-aea5-fb426559f747', options=None) >Thread-14::DEBUG::2014-09-04 21:03:51,607::__init__::225::IOProcess::(_processLogs) (844140) Got request for method 'statvfs' >Dummy-41::DEBUG::2014-09-04 21:03:51,647::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.472851 s, 2.2 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-04 21:03:51,648::__init__::225::IOProcess::(_processLogs) (844140) Queuing response >Thread-14::DEBUG::2014-09-04 21:03:51,653::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-43::DEBUG::2014-09-04 21:03:51,656::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.78390355-2a2d-41e5-aea5-fb426559f747`ReqID=`c30aed2a-b88f-4a53-9bc4-24af4fa0b269`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-14::DEBUG::2014-09-04 21:03:51,836::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-43::DEBUG::2014-09-04 21:03:51,838::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.78390355-2a2d-41e5-aea5-fb426559f747' for lock type 'shared' >Thread-43::DEBUG::2014-09-04 21:03:51,846::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.78390355-2a2d-41e5-aea5-fb426559f747' is free. Now locking as 'shared' (1 active user) >Thread-43::DEBUG::2014-09-04 21:03:51,851::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.78390355-2a2d-41e5-aea5-fb426559f747`ReqID=`c30aed2a-b88f-4a53-9bc4-24af4fa0b269`::Granted request >Thread-14::DEBUG::2014-09-04 21:03:51,860::__init__::225::IOProcess::(_processLogs) Message size is 190 >Thread-43::DEBUG::2014-09-04 21:03:51,866::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`6972389f-0b03-4d81-ae42-57dd660a79ad`::_resourcesAcquired: Storage.78390355-2a2d-41e5-aea5-fb426559f747 (shared) >Thread-17::DEBUG::2014-09-04 21:03:51,866::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_artyom__storage__rhevm__35/180c43ee-5baf-41b7-87c7-c0214b51fe8f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-14::DEBUG::2014-09-04 21:03:51,867::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-43::DEBUG::2014-09-04 21:03:51,870::task::993::Storage.TaskManager.Task::(_decref) Task=`6972389f-0b03-4d81-ae42-57dd660a79ad`::ref 1 aborting False >Thread-14::DEBUG::2014-09-04 21:03:52,394::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-17::DEBUG::2014-09-04 21:03:52,402::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n474 bytes (474 B) copied, 0.000333622 s, 1.4 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-04 21:03:52,403::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:03:52,410::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:03:52,414::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:03:52,419::__init__::225::IOProcess::(_processLogs) (844141) Finding callback 'statvfs'... >Thread-14::DEBUG::2014-09-04 21:03:52,424::__init__::225::IOProcess::(_processLogs) (844141) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-04 21:03:52,429::__init__::225::IOProcess::(_processLogs) (844141) Queuing response >Thread-14::DEBUG::2014-09-04 21:03:52,434::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:03:52,438::__init__::225::IOProcess::(_processLogs) Sending response sized 329 >Thread-14::DEBUG::2014-09-04 21:03:52,459::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-14::DEBUG::2014-09-04 21:03:52,465::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:03:52,470::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-04 21:03:52,474::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:03:52,478::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:03:52,483::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:03:52,486::__init__::225::IOProcess::(_processLogs) (844142) Finding callback 'statvfs'... >Thread-14::DEBUG::2014-09-04 21:03:52,487::__init__::225::IOProcess::(_processLogs) (844142) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-04 21:03:52,490::__init__::225::IOProcess::(_processLogs) (844142) Building response >Thread-14::DEBUG::2014-09-04 21:03:52,493::__init__::225::IOProcess::(_processLogs) (844142) Queuing response >Thread-14::DEBUG::2014-09-04 21:03:52,496::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:03:52,500::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-43::INFO::2014-09-04 21:03:52,503::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': u'/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_qa_shared__iso__domain/7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 8L, 'domains': '180c43ee-5baf-41b7-87c7-c0214b51fe8f:Active,7ad04229-b793-4f73-ad10-5e41a4e836ff:Active,7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6:Active', 'master_uuid': u'180c43ee-5baf-41b7-87c7-c0214b51fe8f', 'version': '3', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'180c43ee-5baf-41b7-87c7-c0214b51fe8f': {'status': 'Active', 'diskfree': '1820606398464', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246104576', 'version': 3}, '7ad04229-b793-4f73-ad10-5e41a4e836ff': {'status': 'Active', 'diskfree': '1820606398464', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246104576', 'version': 0}, '7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6': {'status': 'Active', 'diskfree': '18882756608', 'isoprefix': u'/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_qa_shared__iso__domain/7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '652611682304', 'version': 0}}} >Thread-43::DEBUG::2014-09-04 21:03:52,508::task::1191::Storage.TaskManager.Task::(prepare) Task=`6972389f-0b03-4d81-ae42-57dd660a79ad`::finished: {'info': {'name': 'No Description', 'isoprefix': u'/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_qa_shared__iso__domain/7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 8L, 'domains': '180c43ee-5baf-41b7-87c7-c0214b51fe8f:Active,7ad04229-b793-4f73-ad10-5e41a4e836ff:Active,7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6:Active', 'master_uuid': u'180c43ee-5baf-41b7-87c7-c0214b51fe8f', 'version': '3', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'180c43ee-5baf-41b7-87c7-c0214b51fe8f': {'status': 'Active', 'diskfree': '1820606398464', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246104576', 'version': 3}, '7ad04229-b793-4f73-ad10-5e41a4e836ff': {'status': 'Active', 'diskfree': '1820606398464', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246104576', 'version': 0}, '7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6': {'status': 'Active', 'diskfree': '18882756608', 'isoprefix': u'/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_qa_shared__iso__domain/7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '652611682304', 'version': 0}}} >Thread-43::DEBUG::2014-09-04 21:03:52,511::task::595::Storage.TaskManager.Task::(_updateState) Task=`6972389f-0b03-4d81-ae42-57dd660a79ad`::moving from state preparing -> state finished >Thread-43::DEBUG::2014-09-04 21:03:52,515::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.78390355-2a2d-41e5-aea5-fb426559f747': < ResourceRef 'Storage.78390355-2a2d-41e5-aea5-fb426559f747', isValid: 'True' obj: 'None'>} >Thread-14::DEBUG::2014-09-04 21:03:52,519::__init__::225::IOProcess::(_processLogs) Message size is 166 >Thread-43::DEBUG::2014-09-04 21:03:52,519::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-09-04 21:03:52,524::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-43::DEBUG::2014-09-04 21:03:52,527::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.78390355-2a2d-41e5-aea5-fb426559f747' >Thread-14::DEBUG::2014-09-04 21:03:52,528::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-43::DEBUG::2014-09-04 21:03:52,533::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.78390355-2a2d-41e5-aea5-fb426559f747' (0 active users) >Thread-14::DEBUG::2014-09-04 21:03:52,533::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-43::DEBUG::2014-09-04 21:03:52,535::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.78390355-2a2d-41e5-aea5-fb426559f747' is free, finding out if anyone is waiting for it. >Thread-14::DEBUG::2014-09-04 21:03:52,538::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-43::DEBUG::2014-09-04 21:03:52,539::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.78390355-2a2d-41e5-aea5-fb426559f747', Clearing records. >Thread-14::DEBUG::2014-09-04 21:03:52,542::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:03:52,546::__init__::225::IOProcess::(_processLogs) (844143) Finding callback 'statvfs'... >Thread-43::DEBUG::2014-09-04 21:03:52,546::task::993::Storage.TaskManager.Task::(_decref) Task=`6972389f-0b03-4d81-ae42-57dd660a79ad`::ref 0 aborting False >Thread-14::DEBUG::2014-09-04 21:03:52,550::__init__::225::IOProcess::(_processLogs) (844143) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-04 21:03:52,555::__init__::225::IOProcess::(_processLogs) (844143) Queuing response >Thread-14::DEBUG::2014-09-04 21:03:52,559::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:03:52,563::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-14::DEBUG::2014-09-04 21:03:52,582::__init__::225::IOProcess::(_processLogs) Message size is 183 >Thread-14::DEBUG::2014-09-04 21:03:52,584::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:03:52,587::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-04 21:03:52,590::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:03:52,593::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:03:52,596::__init__::225::IOProcess::(_processLogs) (844144) Finding callback 'access'... >Thread-14::DEBUG::2014-09-04 21:03:52,599::__init__::225::IOProcess::(_processLogs) (844144) Got request for method 'access' >Thread-14::DEBUG::2014-09-04 21:03:52,602::__init__::225::IOProcess::(_processLogs) (844144) Building response >Thread-14::DEBUG::2014-09-04 21:03:52,605::__init__::225::IOProcess::(_processLogs) (844144) Queuing response >Thread-14::DEBUG::2014-09-04 21:03:52,608::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:03:52,611::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-14::DEBUG::2014-09-04 21:03:52,621::__init__::225::IOProcess::(_processLogs) Message size is 187 >Thread-14::DEBUG::2014-09-04 21:03:52,624::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:03:52,627::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-04 21:03:52,630::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:03:52,633::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:03:52,636::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:03:52,639::__init__::225::IOProcess::(_processLogs) (844145) Finding callback 'access'... >Thread-14::DEBUG::2014-09-04 21:03:52,642::__init__::225::IOProcess::(_processLogs) (844145) Got request for method 'access' >Thread-14::DEBUG::2014-09-04 21:03:52,646::__init__::225::IOProcess::(_processLogs) (844145) Queuing response >Thread-14::DEBUG::2014-09-04 21:03:52,648::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:03:52,651::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-14::DEBUG::2014-09-04 21:03:52,662::__init__::225::IOProcess::(_processLogs) Message size is 189 >Thread-14::DEBUG::2014-09-04 21:03:52,665::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:03:52,668::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-04 21:03:52,671::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:03:52,674::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:03:52,677::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:03:52,680::__init__::225::IOProcess::(_processLogs) (844146) Finding callback 'access'... >Thread-14::DEBUG::2014-09-04 21:03:52,683::__init__::225::IOProcess::(_processLogs) (844146) Got request for method 'access' >Thread-14::DEBUG::2014-09-04 21:03:52,686::__init__::225::IOProcess::(_processLogs) (844146) Building response >Thread-14::DEBUG::2014-09-04 21:03:52,689::__init__::225::IOProcess::(_processLogs) (844146) Queuing response >Thread-14::DEBUG::2014-09-04 21:03:52,692::__init__::225::IOProcess::(_processLogs) Generating json... >Dummy-41::DEBUG::2014-09-04 21:03:54,806::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/78390355-2a2d-41e5-aea5-fb426559f747/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >GuestMonitor-quota__vm::DEBUG::2014-09-04 21:03:55,142::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >GuestMonitor-numa__test::DEBUG::2014-09-04 21:03:55,145::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >GuestMonitor-quota__vm::DEBUG::2014-09-04 21:03:55,148::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >GuestMonitor-numa__test::DEBUG::2014-09-04 21:03:55,158::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >GuestMonitor-quota__vm::DEBUG::2014-09-04 21:03:55,161::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >GuestMonitor-numa__test::DEBUG::2014-09-04 21:03:55,170::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >Dummy-41::DEBUG::2014-09-04 21:03:55,214::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.038748 s, 26.4 MB/s\n'; <rc> = 0 >Thread-13916::DEBUG::2014-09-04 21:03:56,057::task::595::Storage.TaskManager.Task::(_updateState) Task=`cdec364f-a8da-48ee-827d-8e0397617ec1`::moving from state init -> state preparing >Thread-13916::INFO::2014-09-04 21:03:56,058::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13916::INFO::2014-09-04 21:03:56,060::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180c43ee-5baf-41b7-87c7-c0214b51fe8f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000333622', 'lastCheck': '3.4', 'valid': True}, '7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00106782', 'lastCheck': '3.6', 'valid': True}, '7ad04229-b793-4f73-ad10-5e41a4e836ff': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000276498', 'lastCheck': '3.5', 'valid': True}} >Thread-13916::DEBUG::2014-09-04 21:03:56,061::task::1191::Storage.TaskManager.Task::(prepare) Task=`cdec364f-a8da-48ee-827d-8e0397617ec1`::finished: {'180c43ee-5baf-41b7-87c7-c0214b51fe8f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000333622', 'lastCheck': '3.4', 'valid': True}, '7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00106782', 'lastCheck': '3.6', 'valid': True}, '7ad04229-b793-4f73-ad10-5e41a4e836ff': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000276498', 'lastCheck': '3.5', 'valid': True}} >Thread-13916::DEBUG::2014-09-04 21:03:56,062::task::595::Storage.TaskManager.Task::(_updateState) Task=`cdec364f-a8da-48ee-827d-8e0397617ec1`::moving from state preparing -> state finished >Thread-13916::DEBUG::2014-09-04 21:03:56,062::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13916::DEBUG::2014-09-04 21:03:56,063::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13916::DEBUG::2014-09-04 21:03:56,064::task::993::Storage.TaskManager.Task::(_decref) Task=`cdec364f-a8da-48ee-827d-8e0397617ec1`::ref 0 aborting False >Thread-13916::DEBUG::2014-09-04 21:03:56,114::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >Thread-13916::DEBUG::2014-09-04 21:03:56,117::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >Dummy-41::DEBUG::2014-09-04 21:03:57,355::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/78390355-2a2d-41e5-aea5-fb426559f747/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-41::DEBUG::2014-09-04 21:03:57,936::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.216688 s, 4.7 MB/s\n'; <rc> = 0 >Dummy-41::DEBUG::2014-09-04 21:03:59,953::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/78390355-2a2d-41e5-aea5-fb426559f747/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >GuestMonitor-numa__test::DEBUG::2014-09-04 21:04:00,291::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >GuestMonitor-quota__vm::DEBUG::2014-09-04 21:04:00,293::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >GuestMonitor-numa__test::DEBUG::2014-09-04 21:04:00,301::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >GuestMonitor-quota__vm::DEBUG::2014-09-04 21:04:00,304::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >GuestMonitor-numa__test::DEBUG::2014-09-04 21:04:00,310::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >GuestMonitor-quota__vm::DEBUG::2014-09-04 21:04:00,316::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >Dummy-41::DEBUG::2014-09-04 21:04:00,354::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0512688 s, 20.0 MB/s\n'; <rc> = 0 >Dummy-41::DEBUG::2014-09-04 21:04:02,374::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/78390355-2a2d-41e5-aea5-fb426559f747/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-14::DEBUG::2014-09-04 21:04:02,697::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-13916::DEBUG::2014-09-04 21:04:02,697::BindingXMLRPC::318::vds::(wrapper) client [10.35.163.104] >Thread-14::DEBUG::2014-09-04 21:04:02,700::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-13916::DEBUG::2014-09-04 21:04:02,704::task::595::Storage.TaskManager.Task::(_updateState) Task=`b54a969e-ad12-4358-84fa-5341d176964b`::moving from state init -> state preparing >Thread-14::DEBUG::2014-09-04 21:04:02,704::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-13916::INFO::2014-09-04 21:04:02,707::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='78390355-2a2d-41e5-aea5-fb426559f747', options=None) >Thread-14::DEBUG::2014-09-04 21:04:02,708::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:04:02,710::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:04:02,711::__init__::225::IOProcess::(_processLogs) (844147) Finding callback 'statvfs'... >Thread-14::DEBUG::2014-09-04 21:04:02,712::__init__::225::IOProcess::(_processLogs) (844147) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-04 21:04:02,713::__init__::225::IOProcess::(_processLogs) (844147) Building response >Thread-14::DEBUG::2014-09-04 21:04:02,714::__init__::225::IOProcess::(_processLogs) (844147) Queuing response >Thread-14::DEBUG::2014-09-04 21:04:02,714::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:04:02,715::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-14::DEBUG::2014-09-04 21:04:02,719::__init__::225::IOProcess::(_processLogs) Message size is 190 >Thread-10379::DEBUG::2014-09-04 21:04:02,721::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mavital/7ad04229-b793-4f73-ad10-5e41a4e836ff/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-13916::INFO::2014-09-04 21:04:02,722::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 8L}} >Thread-14::DEBUG::2014-09-04 21:04:02,722::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-13916::DEBUG::2014-09-04 21:04:03,042::task::1191::Storage.TaskManager.Task::(prepare) Task=`b54a969e-ad12-4358-84fa-5341d176964b`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 8L}} >Thread-14::DEBUG::2014-09-04 21:04:03,043::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-10379::DEBUG::2014-09-04 21:04:03,046::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n339 bytes (339 B) copied, 0.000347093 s, 977 kB/s\n'; <rc> = 0 >Thread-13916::DEBUG::2014-09-04 21:04:03,046::task::595::Storage.TaskManager.Task::(_updateState) Task=`b54a969e-ad12-4358-84fa-5341d176964b`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-09-04 21:04:03,049::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-13916::DEBUG::2014-09-04 21:04:03,053::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-09-04 21:04:03,055::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-13916::DEBUG::2014-09-04 21:04:03,056::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-09-04 21:04:03,059::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-13916::DEBUG::2014-09-04 21:04:03,060::task::993::Storage.TaskManager.Task::(_decref) Task=`b54a969e-ad12-4358-84fa-5341d176964b`::ref 0 aborting False >Thread-14::DEBUG::2014-09-04 21:04:03,063::__init__::225::IOProcess::(_processLogs) (844148) Finding callback 'statvfs'... >Thread-14::DEBUG::2014-09-04 21:04:03,067::__init__::225::IOProcess::(_processLogs) (844148) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-04 21:04:03,072::__init__::225::IOProcess::(_processLogs) (844148) Queuing response >Thread-14::DEBUG::2014-09-04 21:04:03,075::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:04:03,078::__init__::225::IOProcess::(_processLogs) Sending response sized 329 >Dummy-41::DEBUG::2014-09-04 21:04:03,126::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.39367 s, 2.6 MB/s\n'; <rc> = 0 >Thread-43::DEBUG::2014-09-04 21:04:03,127::BindingXMLRPC::318::vds::(wrapper) client [10.35.163.104] >Thread-14::DEBUG::2014-09-04 21:04:03,129::__init__::225::IOProcess::(_processLogs) Message size is 166 >Thread-18::DEBUG::2014-09-04 21:04:03,134::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_qa_shared__iso__domain/7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-14::DEBUG::2014-09-04 21:04:03,135::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-43::DEBUG::2014-09-04 21:04:03,450::task::595::Storage.TaskManager.Task::(_updateState) Task=`be3c44fb-e90e-41e6-b4e0-b536730959e2`::moving from state init -> state preparing >Thread-14::DEBUG::2014-09-04 21:04:03,463::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-43::INFO::2014-09-04 21:04:03,468::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='78390355-2a2d-41e5-aea5-fb426559f747', options=None) >Thread-14::DEBUG::2014-09-04 21:04:03,631::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-09-04 21:04:03,635::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1618 bytes (1.6 kB) copied, 0.00142526 s, 1.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-04 21:04:03,646::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-43::DEBUG::2014-09-04 21:04:03,651::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.78390355-2a2d-41e5-aea5-fb426559f747`ReqID=`3b339596-95fc-47b3-a348-d5ae3e3e58e9`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-14::DEBUG::2014-09-04 21:04:03,652::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-43::DEBUG::2014-09-04 21:04:03,654::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.78390355-2a2d-41e5-aea5-fb426559f747' for lock type 'shared' >Thread-14::DEBUG::2014-09-04 21:04:03,657::__init__::225::IOProcess::(_processLogs) (844149) Finding callback 'statvfs'... >Thread-43::DEBUG::2014-09-04 21:04:03,661::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.78390355-2a2d-41e5-aea5-fb426559f747' is free. Now locking as 'shared' (1 active user) >Thread-14::DEBUG::2014-09-04 21:04:03,663::__init__::225::IOProcess::(_processLogs) (844149) Got request for method 'statvfs' >Thread-43::DEBUG::2014-09-04 21:04:03,664::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.78390355-2a2d-41e5-aea5-fb426559f747`ReqID=`3b339596-95fc-47b3-a348-d5ae3e3e58e9`::Granted request >Thread-14::DEBUG::2014-09-04 21:04:03,668::__init__::225::IOProcess::(_processLogs) (844149) Queuing response >Thread-43::DEBUG::2014-09-04 21:04:03,673::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`be3c44fb-e90e-41e6-b4e0-b536730959e2`::_resourcesAcquired: Storage.78390355-2a2d-41e5-aea5-fb426559f747 (shared) >Thread-14::DEBUG::2014-09-04 21:04:03,673::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-43::DEBUG::2014-09-04 21:04:03,676::task::993::Storage.TaskManager.Task::(_decref) Task=`be3c44fb-e90e-41e6-b4e0-b536730959e2`::ref 1 aborting False >Thread-14::DEBUG::2014-09-04 21:04:03,678::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-14::DEBUG::2014-09-04 21:04:03,701::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-17::DEBUG::2014-09-04 21:04:03,706::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_artyom__storage__rhevm__35/180c43ee-5baf-41b7-87c7-c0214b51fe8f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-14::DEBUG::2014-09-04 21:04:03,706::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:04:04,223::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-04 21:04:04,231::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:04:04,236::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:04:04,241::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-09-04 21:04:04,240::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n474 bytes (474 B) copied, 0.000443885 s, 1.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-04 21:04:04,246::__init__::225::IOProcess::(_processLogs) (844150) Finding callback 'statvfs'... >Thread-14::DEBUG::2014-09-04 21:04:04,254::__init__::225::IOProcess::(_processLogs) (844150) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-04 21:04:04,259::__init__::225::IOProcess::(_processLogs) (844150) Queuing response >Thread-14::DEBUG::2014-09-04 21:04:04,263::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:04:04,267::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-14::DEBUG::2014-09-04 21:04:04,283::__init__::225::IOProcess::(_processLogs) Message size is 190 >Thread-14::DEBUG::2014-09-04 21:04:04,287::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:04:04,290::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-04 21:04:04,293::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:04:04,295::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:04:04,299::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-43::INFO::2014-09-04 21:04:04,302::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': u'/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_qa_shared__iso__domain/7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 8L, 'domains': '180c43ee-5baf-41b7-87c7-c0214b51fe8f:Active,7ad04229-b793-4f73-ad10-5e41a4e836ff:Active,7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6:Active', 'master_uuid': u'180c43ee-5baf-41b7-87c7-c0214b51fe8f', 'version': '3', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'180c43ee-5baf-41b7-87c7-c0214b51fe8f': {'status': 'Active', 'diskfree': '1820606398464', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246104576', 'version': 3}, '7ad04229-b793-4f73-ad10-5e41a4e836ff': {'status': 'Active', 'diskfree': '1820606267392', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246104576', 'version': 0}, '7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6': {'status': 'Active', 'diskfree': '18882756608', 'isoprefix': u'/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_qa_shared__iso__domain/7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '652611682304', 'version': 0}}} >Thread-14::DEBUG::2014-09-04 21:04:04,304::__init__::225::IOProcess::(_processLogs) (844151) Finding callback 'statvfs'... >Thread-43::DEBUG::2014-09-04 21:04:04,308::task::1191::Storage.TaskManager.Task::(prepare) Task=`be3c44fb-e90e-41e6-b4e0-b536730959e2`::finished: {'info': {'name': 'No Description', 'isoprefix': u'/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_qa_shared__iso__domain/7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 8L, 'domains': '180c43ee-5baf-41b7-87c7-c0214b51fe8f:Active,7ad04229-b793-4f73-ad10-5e41a4e836ff:Active,7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6:Active', 'master_uuid': u'180c43ee-5baf-41b7-87c7-c0214b51fe8f', 'version': '3', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'180c43ee-5baf-41b7-87c7-c0214b51fe8f': {'status': 'Active', 'diskfree': '1820606398464', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246104576', 'version': 3}, '7ad04229-b793-4f73-ad10-5e41a4e836ff': {'status': 'Active', 'diskfree': '1820606267392', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246104576', 'version': 0}, '7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6': {'status': 'Active', 'diskfree': '18882756608', 'isoprefix': u'/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_qa_shared__iso__domain/7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '652611682304', 'version': 0}}} >Thread-14::DEBUG::2014-09-04 21:04:04,312::__init__::225::IOProcess::(_processLogs) (844151) Got request for method 'statvfs' >Thread-43::DEBUG::2014-09-04 21:04:04,313::task::595::Storage.TaskManager.Task::(_updateState) Task=`be3c44fb-e90e-41e6-b4e0-b536730959e2`::moving from state preparing -> state finished >Thread-43::DEBUG::2014-09-04 21:04:04,317::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.78390355-2a2d-41e5-aea5-fb426559f747': < ResourceRef 'Storage.78390355-2a2d-41e5-aea5-fb426559f747', isValid: 'True' obj: 'None'>} >Thread-14::DEBUG::2014-09-04 21:04:04,318::__init__::225::IOProcess::(_processLogs) (844151) Queuing response >Thread-43::DEBUG::2014-09-04 21:04:04,321::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-09-04 21:04:04,323::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:04:04,328::__init__::225::IOProcess::(_processLogs) Sending response sized 329 >Thread-43::DEBUG::2014-09-04 21:04:04,329::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.78390355-2a2d-41e5-aea5-fb426559f747' >Thread-43::DEBUG::2014-09-04 21:04:04,336::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.78390355-2a2d-41e5-aea5-fb426559f747' (0 active users) >Thread-43::DEBUG::2014-09-04 21:04:04,340::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.78390355-2a2d-41e5-aea5-fb426559f747' is free, finding out if anyone is waiting for it. >Thread-43::DEBUG::2014-09-04 21:04:04,345::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.78390355-2a2d-41e5-aea5-fb426559f747', Clearing records. >Thread-14::DEBUG::2014-09-04 21:04:04,354::__init__::225::IOProcess::(_processLogs) Message size is 166 >Thread-43::DEBUG::2014-09-04 21:04:04,356::task::993::Storage.TaskManager.Task::(_decref) Task=`be3c44fb-e90e-41e6-b4e0-b536730959e2`::ref 0 aborting False >Thread-14::DEBUG::2014-09-04 21:04:04,362::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:04:04,369::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-04 21:04:04,374::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:04:04,383::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:04:04,390::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:04:04,396::__init__::225::IOProcess::(_processLogs) (844152) Finding callback 'statvfs'... >Thread-14::DEBUG::2014-09-04 21:04:04,399::__init__::225::IOProcess::(_processLogs) (844152) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-04 21:04:04,403::__init__::225::IOProcess::(_processLogs) (844152) Building response >Thread-14::DEBUG::2014-09-04 21:04:04,407::__init__::225::IOProcess::(_processLogs) (844152) Queuing response >Thread-14::DEBUG::2014-09-04 21:04:04,409::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:04:04,426::__init__::225::IOProcess::(_processLogs) Message size is 183 >Thread-14::DEBUG::2014-09-04 21:04:04,429::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:04:04,431::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-04 21:04:04,433::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:04:04,435::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:04:04,438::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:04:04,440::__init__::225::IOProcess::(_processLogs) (844153) Got request for method 'access' >Thread-14::DEBUG::2014-09-04 21:04:04,443::__init__::225::IOProcess::(_processLogs) (844153) Building response >Thread-14::DEBUG::2014-09-04 21:04:04,445::__init__::225::IOProcess::(_processLogs) (844153) Queuing response >Thread-14::DEBUG::2014-09-04 21:04:04,448::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:04:04,450::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-14::DEBUG::2014-09-04 21:04:04,458::__init__::225::IOProcess::(_processLogs) Message size is 187 >Thread-14::DEBUG::2014-09-04 21:04:04,461::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:04:04,464::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-04 21:04:04,466::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:04:04,468::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:04:04,470::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:04:04,473::__init__::225::IOProcess::(_processLogs) (844154) Finding callback 'access'... >Thread-14::DEBUG::2014-09-04 21:04:04,475::__init__::225::IOProcess::(_processLogs) (844154) Got request for method 'access' >Thread-14::DEBUG::2014-09-04 21:04:04,477::__init__::225::IOProcess::(_processLogs) (844154) Building response >Thread-14::DEBUG::2014-09-04 21:04:04,480::__init__::225::IOProcess::(_processLogs) (844154) Queuing response >Thread-14::DEBUG::2014-09-04 21:04:04,482::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:04:04,484::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-14::DEBUG::2014-09-04 21:04:04,493::__init__::225::IOProcess::(_processLogs) Message size is 189 >Thread-14::DEBUG::2014-09-04 21:04:04,496::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:04:04,498::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-04 21:04:04,500::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:04:04,502::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:04:04,505::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:04:04,507::__init__::225::IOProcess::(_processLogs) (844155) Finding callback 'access'... >Thread-14::DEBUG::2014-09-04 21:04:04,510::__init__::225::IOProcess::(_processLogs) (844155) Got request for method 'access' >Thread-14::DEBUG::2014-09-04 21:04:04,512::__init__::225::IOProcess::(_processLogs) (844155) Building response >Thread-14::DEBUG::2014-09-04 21:04:04,515::__init__::225::IOProcess::(_processLogs) (844155) Queuing response >Thread-14::DEBUG::2014-09-04 21:04:04,517::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:04:04,519::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >GuestMonitor-numa__test::DEBUG::2014-09-04 21:04:05,321::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >GuestMonitor-numa__test::DEBUG::2014-09-04 21:04:05,322::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >GuestMonitor-numa__test::DEBUG::2014-09-04 21:04:05,323::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >GuestMonitor-quota__vm::DEBUG::2014-09-04 21:04:05,326::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >GuestMonitor-quota__vm::DEBUG::2014-09-04 21:04:05,326::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >GuestMonitor-quota__vm::DEBUG::2014-09-04 21:04:05,327::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >VM Channels Listener::DEBUG::2014-09-04 21:04:05,461::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-09-04 21:04:05,461::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 57. >Dummy-41::DEBUG::2014-09-04 21:04:06,670::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/78390355-2a2d-41e5-aea5-fb426559f747/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-41::DEBUG::2014-09-04 21:04:07,047::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0127977 s, 80.0 MB/s\n'; <rc> = 0 >Dummy-41::DEBUG::2014-09-04 21:04:09,059::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/78390355-2a2d-41e5-aea5-fb426559f747/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-41::DEBUG::2014-09-04 21:04:09,626::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.21411 s, 4.8 MB/s\n'; <rc> = 0 >GuestMonitor-numa__test::DEBUG::2014-09-04 21:04:10,329::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >GuestMonitor-numa__test::DEBUG::2014-09-04 21:04:10,330::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >GuestMonitor-numa__test::DEBUG::2014-09-04 21:04:10,331::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >GuestMonitor-quota__vm::DEBUG::2014-09-04 21:04:10,334::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >GuestMonitor-quota__vm::DEBUG::2014-09-04 21:04:10,334::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >GuestMonitor-quota__vm::DEBUG::2014-09-04 21:04:10,335::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >Thread-13916::DEBUG::2014-09-04 21:04:11,227::task::595::Storage.TaskManager.Task::(_updateState) Task=`6d2735ff-d65f-4605-904b-89fd8323f3cf`::moving from state init -> state preparing >Thread-13916::INFO::2014-09-04 21:04:11,227::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13916::INFO::2014-09-04 21:04:11,228::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180c43ee-5baf-41b7-87c7-c0214b51fe8f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000443885', 'lastCheck': '6.7', 'valid': True}, '7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00142526', 'lastCheck': '6.9', 'valid': True}, '7ad04229-b793-4f73-ad10-5e41a4e836ff': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000347093', 'lastCheck': '6.9', 'valid': True}} >Thread-13916::DEBUG::2014-09-04 21:04:11,228::task::1191::Storage.TaskManager.Task::(prepare) Task=`6d2735ff-d65f-4605-904b-89fd8323f3cf`::finished: {'180c43ee-5baf-41b7-87c7-c0214b51fe8f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000443885', 'lastCheck': '6.7', 'valid': True}, '7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00142526', 'lastCheck': '6.9', 'valid': True}, '7ad04229-b793-4f73-ad10-5e41a4e836ff': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000347093', 'lastCheck': '6.9', 'valid': True}} >Thread-13916::DEBUG::2014-09-04 21:04:11,228::task::595::Storage.TaskManager.Task::(_updateState) Task=`6d2735ff-d65f-4605-904b-89fd8323f3cf`::moving from state preparing -> state finished >Thread-13916::DEBUG::2014-09-04 21:04:11,228::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13916::DEBUG::2014-09-04 21:04:11,228::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13916::DEBUG::2014-09-04 21:04:11,228::task::993::Storage.TaskManager.Task::(_decref) Task=`6d2735ff-d65f-4605-904b-89fd8323f3cf`::ref 0 aborting False >Thread-13916::DEBUG::2014-09-04 21:04:11,250::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >Thread-13916::DEBUG::2014-09-04 21:04:11,250::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >Dummy-41::DEBUG::2014-09-04 21:04:11,637::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/78390355-2a2d-41e5-aea5-fb426559f747/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-41::DEBUG::2014-09-04 21:04:12,004::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0127569 s, 80.3 MB/s\n'; <rc> = 0 >Dummy-41::DEBUG::2014-09-04 21:04:14,016::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/78390355-2a2d-41e5-aea5-fb426559f747/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-14::DEBUG::2014-09-04 21:04:14,352::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-14::DEBUG::2014-09-04 21:04:14,354::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:04:14,356::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-04 21:04:14,359::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:04:14,360::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:04:14,362::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:04:14,363::__init__::225::IOProcess::(_processLogs) (844156) Finding callback 'statvfs'... >Thread-14::DEBUG::2014-09-04 21:04:14,364::__init__::225::IOProcess::(_processLogs) (844156) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-04 21:04:14,365::__init__::225::IOProcess::(_processLogs) (844156) Queuing response >Thread-14::DEBUG::2014-09-04 21:04:14,366::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:04:14,367::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-14::DEBUG::2014-09-04 21:04:14,372::__init__::225::IOProcess::(_processLogs) Message size is 190 >Thread-10379::DEBUG::2014-09-04 21:04:14,373::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mavital/7ad04229-b793-4f73-ad10-5e41a4e836ff/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-14::DEBUG::2014-09-04 21:04:14,374::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:04:14,711::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-04 21:04:14,722::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-10379::DEBUG::2014-09-04 21:04:14,722::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n339 bytes (339 B) copied, 0.000328546 s, 1.0 MB/s\n'; <rc> = 0 >Thread-13916::DEBUG::2014-09-04 21:04:14,722::BindingXMLRPC::318::vds::(wrapper) client [10.35.163.104] flowID [7db865c] >Thread-14::DEBUG::2014-09-04 21:04:14,730::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-13916::DEBUG::2014-09-04 21:04:14,737::task::595::Storage.TaskManager.Task::(_updateState) Task=`3c64ef1b-a393-4706-86e9-c96ea275b90f`::moving from state init -> state preparing >Thread-14::DEBUG::2014-09-04 21:04:14,737::__init__::225::IOProcess::(_processLogs) (844157) Finding callback 'statvfs'... >Thread-13916::INFO::2014-09-04 21:04:14,743::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='78390355-2a2d-41e5-aea5-fb426559f747', options=None) >Thread-14::DEBUG::2014-09-04 21:04:14,745::__init__::225::IOProcess::(_processLogs) (844157) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-04 21:04:14,750::__init__::225::IOProcess::(_processLogs) (844157) Building response >Thread-14::DEBUG::2014-09-04 21:04:14,756::__init__::225::IOProcess::(_processLogs) (844157) Queuing response >Thread-14::DEBUG::2014-09-04 21:04:14,760::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-13916::INFO::2014-09-04 21:04:14,762::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 8L}} >Thread-14::DEBUG::2014-09-04 21:04:14,766::__init__::225::IOProcess::(_processLogs) Sending response sized 329 >Thread-13916::DEBUG::2014-09-04 21:04:14,768::task::1191::Storage.TaskManager.Task::(prepare) Task=`3c64ef1b-a393-4706-86e9-c96ea275b90f`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 8L}} >Thread-13916::DEBUG::2014-09-04 21:04:14,807::task::595::Storage.TaskManager.Task::(_updateState) Task=`3c64ef1b-a393-4706-86e9-c96ea275b90f`::moving from state preparing -> state finished >Dummy-41::DEBUG::2014-09-04 21:04:14,809::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.415973 s, 2.5 MB/s\n'; <rc> = 0 >Thread-13916::DEBUG::2014-09-04 21:04:14,813::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13916::DEBUG::2014-09-04 21:04:14,818::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13916::DEBUG::2014-09-04 21:04:14,825::task::993::Storage.TaskManager.Task::(_decref) Task=`3c64ef1b-a393-4706-86e9-c96ea275b90f`::ref 0 aborting False >Thread-14::DEBUG::2014-09-04 21:04:14,829::__init__::225::IOProcess::(_processLogs) Message size is 166 >Thread-14::DEBUG::2014-09-04 21:04:14,837::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-18::DEBUG::2014-09-04 21:04:14,837::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_qa_shared__iso__domain/7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-14::DEBUG::2014-09-04 21:04:14,845::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-04 21:04:15,185::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-09-04 21:04:15,372::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1618 bytes (1.6 kB) copied, 0.000467575 s, 3.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-04 21:04:15,382::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-43::DEBUG::2014-09-04 21:04:15,398::BindingXMLRPC::318::vds::(wrapper) client [10.35.163.104] flowID [7db865c] >GuestMonitor-quota__vm::DEBUG::2014-09-04 21:04:15,399::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >Thread-14::DEBUG::2014-09-04 21:04:15,401::__init__::225::IOProcess::(_processLogs) Extracting request information... >GuestMonitor-numa__test::DEBUG::2014-09-04 21:04:15,400::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >Thread-43::DEBUG::2014-09-04 21:04:15,410::task::595::Storage.TaskManager.Task::(_updateState) Task=`33c52167-ef3e-42c4-a378-26dc42896baa`::moving from state init -> state preparing >Thread-14::DEBUG::2014-09-04 21:04:15,410::__init__::225::IOProcess::(_processLogs) (844158) Finding callback 'statvfs'... >Thread-43::INFO::2014-09-04 21:04:15,417::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='78390355-2a2d-41e5-aea5-fb426559f747', options=None) >Thread-14::DEBUG::2014-09-04 21:04:15,420::__init__::225::IOProcess::(_processLogs) (844158) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-04 21:04:15,430::__init__::225::IOProcess::(_processLogs) (844158) Building response >GuestMonitor-quota__vm::DEBUG::2014-09-04 21:04:15,436::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >Thread-43::DEBUG::2014-09-04 21:04:15,436::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.78390355-2a2d-41e5-aea5-fb426559f747`ReqID=`5b98f9c8-3cb1-483f-8d5a-3c5a9d1c857a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >GuestMonitor-numa__test::DEBUG::2014-09-04 21:04:15,439::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >Thread-14::DEBUG::2014-09-04 21:04:15,439::__init__::225::IOProcess::(_processLogs) (844158) Queuing response >Thread-43::DEBUG::2014-09-04 21:04:15,443::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.78390355-2a2d-41e5-aea5-fb426559f747' for lock type 'shared' >Thread-14::DEBUG::2014-09-04 21:04:15,448::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-43::DEBUG::2014-09-04 21:04:15,452::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.78390355-2a2d-41e5-aea5-fb426559f747' is free. Now locking as 'shared' (1 active user) >Thread-14::DEBUG::2014-09-04 21:04:15,456::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-43::DEBUG::2014-09-04 21:04:15,457::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.78390355-2a2d-41e5-aea5-fb426559f747`ReqID=`5b98f9c8-3cb1-483f-8d5a-3c5a9d1c857a`::Granted request >GuestMonitor-quota__vm::DEBUG::2014-09-04 21:04:15,470::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >GuestMonitor-numa__test::DEBUG::2014-09-04 21:04:15,470::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >Thread-43::DEBUG::2014-09-04 21:04:15,476::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`33c52167-ef3e-42c4-a378-26dc42896baa`::_resourcesAcquired: Storage.78390355-2a2d-41e5-aea5-fb426559f747 (shared) >Thread-43::DEBUG::2014-09-04 21:04:15,482::task::993::Storage.TaskManager.Task::(_decref) Task=`33c52167-ef3e-42c4-a378-26dc42896baa`::ref 1 aborting False >Thread-14::DEBUG::2014-09-04 21:04:15,490::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-17::DEBUG::2014-09-04 21:04:15,494::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_artyom__storage__rhevm__35/180c43ee-5baf-41b7-87c7-c0214b51fe8f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-14::DEBUG::2014-09-04 21:04:15,496::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:04:16,033::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-04 21:04:16,043::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-17::DEBUG::2014-09-04 21:04:16,044::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n474 bytes (474 B) copied, 0.000329173 s, 1.4 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-04 21:04:16,049::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:04:16,054::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:04:16,058::__init__::225::IOProcess::(_processLogs) (844159) Finding callback 'statvfs'... >Thread-14::DEBUG::2014-09-04 21:04:16,062::__init__::225::IOProcess::(_processLogs) (844159) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-04 21:04:16,065::__init__::225::IOProcess::(_processLogs) (844159) Building response >Thread-14::DEBUG::2014-09-04 21:04:16,068::__init__::225::IOProcess::(_processLogs) (844159) Queuing response >Thread-14::DEBUG::2014-09-04 21:04:16,072::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:04:16,076::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-14::DEBUG::2014-09-04 21:04:16,096::__init__::225::IOProcess::(_processLogs) Message size is 190 >Thread-14::DEBUG::2014-09-04 21:04:16,102::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:04:16,106::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-04 21:04:16,110::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:04:16,111::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:04:16,114::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:04:16,117::__init__::225::IOProcess::(_processLogs) (844160) Finding callback 'statvfs'... >Thread-14::DEBUG::2014-09-04 21:04:16,119::__init__::225::IOProcess::(_processLogs) (844160) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-04 21:04:16,123::__init__::225::IOProcess::(_processLogs) (844160) Queuing response >Thread-43::INFO::2014-09-04 21:04:16,126::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': u'/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_qa_shared__iso__domain/7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 8L, 'domains': '180c43ee-5baf-41b7-87c7-c0214b51fe8f:Active,7ad04229-b793-4f73-ad10-5e41a4e836ff:Active,7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6:Active', 'master_uuid': u'180c43ee-5baf-41b7-87c7-c0214b51fe8f', 'version': '3', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'180c43ee-5baf-41b7-87c7-c0214b51fe8f': {'status': 'Active', 'diskfree': '1820606267392', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246104576', 'version': 3}, '7ad04229-b793-4f73-ad10-5e41a4e836ff': {'status': 'Active', 'diskfree': '1820606267392', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246104576', 'version': 0}, '7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6': {'status': 'Active', 'diskfree': '18882756608', 'isoprefix': u'/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_qa_shared__iso__domain/7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '652611682304', 'version': 0}}} >Thread-14::DEBUG::2014-09-04 21:04:16,127::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-43::DEBUG::2014-09-04 21:04:16,130::task::1191::Storage.TaskManager.Task::(prepare) Task=`33c52167-ef3e-42c4-a378-26dc42896baa`::finished: {'info': {'name': 'No Description', 'isoprefix': u'/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_qa_shared__iso__domain/7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 8L, 'domains': '180c43ee-5baf-41b7-87c7-c0214b51fe8f:Active,7ad04229-b793-4f73-ad10-5e41a4e836ff:Active,7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6:Active', 'master_uuid': u'180c43ee-5baf-41b7-87c7-c0214b51fe8f', 'version': '3', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'180c43ee-5baf-41b7-87c7-c0214b51fe8f': {'status': 'Active', 'diskfree': '1820606267392', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246104576', 'version': 3}, '7ad04229-b793-4f73-ad10-5e41a4e836ff': {'status': 'Active', 'diskfree': '1820606267392', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246104576', 'version': 0}, '7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6': {'status': 'Active', 'diskfree': '18882756608', 'isoprefix': u'/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_qa_shared__iso__domain/7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '652611682304', 'version': 0}}} >Thread-14::DEBUG::2014-09-04 21:04:16,131::__init__::225::IOProcess::(_processLogs) Sending response sized 329 >Thread-43::DEBUG::2014-09-04 21:04:16,133::task::595::Storage.TaskManager.Task::(_updateState) Task=`33c52167-ef3e-42c4-a378-26dc42896baa`::moving from state preparing -> state finished >Thread-43::DEBUG::2014-09-04 21:04:16,136::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.78390355-2a2d-41e5-aea5-fb426559f747': < ResourceRef 'Storage.78390355-2a2d-41e5-aea5-fb426559f747', isValid: 'True' obj: 'None'>} >Thread-43::DEBUG::2014-09-04 21:04:16,139::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-43::DEBUG::2014-09-04 21:04:16,145::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.78390355-2a2d-41e5-aea5-fb426559f747' >Thread-14::DEBUG::2014-09-04 21:04:16,148::__init__::225::IOProcess::(_processLogs) Message size is 166 >Thread-14::DEBUG::2014-09-04 21:04:16,153::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-43::DEBUG::2014-09-04 21:04:16,154::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.78390355-2a2d-41e5-aea5-fb426559f747' (0 active users) >Thread-14::DEBUG::2014-09-04 21:04:16,157::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-43::DEBUG::2014-09-04 21:04:16,157::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.78390355-2a2d-41e5-aea5-fb426559f747' is free, finding out if anyone is waiting for it. >Thread-14::DEBUG::2014-09-04 21:04:16,160::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-43::DEBUG::2014-09-04 21:04:16,160::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.78390355-2a2d-41e5-aea5-fb426559f747', Clearing records. >Thread-14::DEBUG::2014-09-04 21:04:16,163::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-43::DEBUG::2014-09-04 21:04:16,167::task::993::Storage.TaskManager.Task::(_decref) Task=`33c52167-ef3e-42c4-a378-26dc42896baa`::ref 0 aborting False >Thread-14::DEBUG::2014-09-04 21:04:16,167::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:04:16,174::__init__::225::IOProcess::(_processLogs) (844161) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-04 21:04:16,177::__init__::225::IOProcess::(_processLogs) (844161) Building response >Thread-14::DEBUG::2014-09-04 21:04:16,181::__init__::225::IOProcess::(_processLogs) (844161) Queuing response >Thread-14::DEBUG::2014-09-04 21:04:16,185::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:04:16,188::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-14::DEBUG::2014-09-04 21:04:16,201::__init__::225::IOProcess::(_processLogs) Message size is 183 >Thread-14::DEBUG::2014-09-04 21:04:16,203::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:04:16,206::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-04 21:04:16,208::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:04:16,210::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:04:16,212::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:04:16,215::__init__::225::IOProcess::(_processLogs) (844162) Finding callback 'access'... >Thread-14::DEBUG::2014-09-04 21:04:16,217::__init__::225::IOProcess::(_processLogs) (844162) Got request for method 'access' >Thread-14::DEBUG::2014-09-04 21:04:16,219::__init__::225::IOProcess::(_processLogs) (844162) Building response >Thread-14::DEBUG::2014-09-04 21:04:16,221::__init__::225::IOProcess::(_processLogs) (844162) Queuing response >Thread-14::DEBUG::2014-09-04 21:04:16,224::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:04:16,226::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-14::DEBUG::2014-09-04 21:04:16,234::__init__::225::IOProcess::(_processLogs) (844162) Got request for method 'access'DEBUG|Receiving request... >Thread-14::DEBUG::2014-09-04 21:04:16,236::__init__::225::IOProcess::(_processLogs) Message size is 187 >Thread-14::DEBUG::2014-09-04 21:04:16,238::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:04:16,240::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-04 21:04:16,243::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:04:16,246::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:04:16,248::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:04:16,251::__init__::225::IOProcess::(_processLogs) (844163) Finding callback 'access'... >Thread-14::DEBUG::2014-09-04 21:04:16,253::__init__::225::IOProcess::(_processLogs) (844163) Got request for method 'access' >Thread-14::DEBUG::2014-09-04 21:04:16,255::__init__::225::IOProcess::(_processLogs) (844163) Building response >Thread-14::DEBUG::2014-09-04 21:04:16,257::__init__::225::IOProcess::(_processLogs) (844163) Queuing response >Thread-14::DEBUG::2014-09-04 21:04:16,260::__init__::225::IOProcess::(_processLogs) (844162) Got request for method 'access'DEBUG|Generating json... >Thread-14::DEBUG::2014-09-04 21:04:16,263::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-14::DEBUG::2014-09-04 21:04:16,271::__init__::225::IOProcess::(_processLogs) (844162) Got request for method 'access'DEBUG|Receiving request... >Thread-14::DEBUG::2014-09-04 21:04:16,273::__init__::225::IOProcess::(_processLogs) Message size is 189 >Thread-14::DEBUG::2014-09-04 21:04:16,276::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:04:16,278::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-04 21:04:16,281::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:04:16,284::__init__::225::IOProcess::(_processLogs) (844162) Got request for method 'access'DEBUG|Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:04:16,286::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:04:16,289::__init__::225::IOProcess::(_processLogs) (844164) Finding callback 'access'... >Thread-14::DEBUG::2014-09-04 21:04:16,291::__init__::225::IOProcess::(_processLogs) (844164) Got request for method 'access' >Thread-14::DEBUG::2014-09-04 21:04:16,294::__init__::225::IOProcess::(_processLogs) (844164) Building response >Thread-14::DEBUG::2014-09-04 21:04:16,296::__init__::225::IOProcess::(_processLogs) (844164) Queuing response >Thread-14::DEBUG::2014-09-04 21:04:16,299::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:04:16,301::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-41::DEBUG::2014-09-04 21:04:18,415::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/78390355-2a2d-41e5-aea5-fb426559f747/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-41::DEBUG::2014-09-04 21:04:18,790::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0127984 s, 80.0 MB/s\n'; <rc> = 0 >GuestMonitor-numa__test::DEBUG::2014-09-04 21:04:20,505::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >GuestMonitor-quota__vm::DEBUG::2014-09-04 21:04:20,504::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >GuestMonitor-numa__test::DEBUG::2014-09-04 21:04:20,510::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >GuestMonitor-quota__vm::DEBUG::2014-09-04 21:04:20,511::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >GuestMonitor-numa__test::DEBUG::2014-09-04 21:04:20,515::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >GuestMonitor-quota__vm::DEBUG::2014-09-04 21:04:20,516::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >Dummy-41::DEBUG::2014-09-04 21:04:20,802::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/78390355-2a2d-41e5-aea5-fb426559f747/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-41::DEBUG::2014-09-04 21:04:21,181::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0127399 s, 80.4 MB/s\n'; <rc> = 0 >Dummy-41::DEBUG::2014-09-04 21:04:23,377::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/78390355-2a2d-41e5-aea5-fb426559f747/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-41::DEBUG::2014-09-04 21:04:23,765::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0310398 s, 33.0 MB/s\n'; <rc> = 0 >GuestMonitor-numa__test::DEBUG::2014-09-04 21:04:25,529::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >GuestMonitor-quota__vm::DEBUG::2014-09-04 21:04:25,531::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >GuestMonitor-numa__test::DEBUG::2014-09-04 21:04:25,538::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >GuestMonitor-quota__vm::DEBUG::2014-09-04 21:04:25,543::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >GuestMonitor-numa__test::DEBUG::2014-09-04 21:04:25,545::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >GuestMonitor-quota__vm::DEBUG::2014-09-04 21:04:25,552::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >Dummy-41::DEBUG::2014-09-04 21:04:25,780::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/78390355-2a2d-41e5-aea5-fb426559f747/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-14::DEBUG::2014-09-04 21:04:26,109::__init__::225::IOProcess::(_processLogs) (844162) Got request for method 'access'DEBUG|Receiving request... >Thread-14::DEBUG::2014-09-04 21:04:26,113::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-14::DEBUG::2014-09-04 21:04:26,117::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:04:26,122::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-04 21:04:26,127::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:04:26,130::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:04:26,134::__init__::225::IOProcess::(_processLogs) (844162) Got request for method 'access'DEBUG|Extracting request information... >Thread-14::DEBUG::2014-09-04 21:04:26,138::__init__::225::IOProcess::(_processLogs) (844165) Finding callback 'statvfs'... >Thread-14::DEBUG::2014-09-04 21:04:26,141::__init__::225::IOProcess::(_processLogs) (844165) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-04 21:04:26,143::__init__::225::IOProcess::(_processLogs) (844165) Building response >Thread-14::DEBUG::2014-09-04 21:04:26,146::__init__::225::IOProcess::(_processLogs) (844165) Queuing response >Thread-14::DEBUG::2014-09-04 21:04:26,148::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:04:26,150::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-14::DEBUG::2014-09-04 21:04:26,163::__init__::225::IOProcess::(_processLogs) (844162) Got request for method 'access'DEBUG|Receiving request... >Thread-10379::DEBUG::2014-09-04 21:04:26,166::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mavital/7ad04229-b793-4f73-ad10-5e41a4e836ff/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-14::DEBUG::2014-09-04 21:04:26,167::__init__::225::IOProcess::(_processLogs) Message size is 190 >Thread-14::DEBUG::2014-09-04 21:04:26,506::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-13916::DEBUG::2014-09-04 21:04:26,513::BindingXMLRPC::318::vds::(wrapper) client [10.35.163.104] flowID [6ecd2f33] >Thread-14::DEBUG::2014-09-04 21:04:26,513::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-10379::DEBUG::2014-09-04 21:04:26,513::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n339 bytes (339 B) copied, 0.000331561 s, 1.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-04 21:04:26,522::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-13916::DEBUG::2014-09-04 21:04:26,525::task::595::Storage.TaskManager.Task::(_updateState) Task=`0f9e1cd8-5839-4d2c-b147-29fb452d6aa0`::moving from state init -> state preparing >Thread-14::DEBUG::2014-09-04 21:04:26,563::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-13916::INFO::2014-09-04 21:04:26,565::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='78390355-2a2d-41e5-aea5-fb426559f747', options=None) >Dummy-41::DEBUG::2014-09-04 21:04:26,566::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.414932 s, 2.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-04 21:04:26,567::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:04:26,571::__init__::225::IOProcess::(_processLogs) (844166) Finding callback 'statvfs'... >Thread-14::DEBUG::2014-09-04 21:04:26,574::__init__::225::IOProcess::(_processLogs) (844166) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-04 21:04:26,576::__init__::225::IOProcess::(_processLogs) (844162) Got request for method 'access'DEBUG|(844166) Building response >Thread-14::DEBUG::2014-09-04 21:04:26,578::__init__::225::IOProcess::(_processLogs) (844166) Queuing response >Thread-14::DEBUG::2014-09-04 21:04:26,581::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-13916::INFO::2014-09-04 21:04:26,582::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 8L}} >Thread-14::DEBUG::2014-09-04 21:04:26,585::__init__::225::IOProcess::(_processLogs) Sending response sized 329 >Thread-13916::DEBUG::2014-09-04 21:04:26,586::task::1191::Storage.TaskManager.Task::(prepare) Task=`0f9e1cd8-5839-4d2c-b147-29fb452d6aa0`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 8L}} >Thread-13916::DEBUG::2014-09-04 21:04:26,590::task::595::Storage.TaskManager.Task::(_updateState) Task=`0f9e1cd8-5839-4d2c-b147-29fb452d6aa0`::moving from state preparing -> state finished >Thread-13916::DEBUG::2014-09-04 21:04:26,593::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13916::DEBUG::2014-09-04 21:04:26,597::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13916::DEBUG::2014-09-04 21:04:26,602::task::993::Storage.TaskManager.Task::(_decref) Task=`0f9e1cd8-5839-4d2c-b147-29fb452d6aa0`::ref 0 aborting False >Thread-14::DEBUG::2014-09-04 21:04:26,602::__init__::225::IOProcess::(_processLogs) (844162) Got request for method 'access'DEBUG|Receiving request... >Thread-18::DEBUG::2014-09-04 21:04:26,607::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_qa_shared__iso__domain/7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-14::DEBUG::2014-09-04 21:04:26,609::__init__::225::IOProcess::(_processLogs) Message size is 166 >Thread-14::DEBUG::2014-09-04 21:04:26,927::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:04:27,108::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-09-04 21:04:27,112::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1618 bytes (1.6 kB) copied, 0.000868951 s, 1.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-04 21:04:27,122::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-43::DEBUG::2014-09-04 21:04:27,129::BindingXMLRPC::318::vds::(wrapper) client [10.35.163.104] flowID [6ecd2f33] >Thread-14::DEBUG::2014-09-04 21:04:27,131::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:04:27,138::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14054::DEBUG::2014-09-04 21:04:27,139::task::595::Storage.TaskManager.Task::(_updateState) Task=`1ac46a9b-ae8d-473e-985d-5630fc743f12`::moving from state init -> state preparing >Thread-43::DEBUG::2014-09-04 21:04:27,142::task::595::Storage.TaskManager.Task::(_updateState) Task=`5fcd415f-a2a0-4013-832b-cf04bfc8b581`::moving from state init -> state preparing >Thread-14::DEBUG::2014-09-04 21:04:27,145::__init__::225::IOProcess::(_processLogs) (844167) Finding callback 'statvfs'... >Thread-14054::INFO::2014-09-04 21:04:27,145::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-43::INFO::2014-09-04 21:04:27,149::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='78390355-2a2d-41e5-aea5-fb426559f747', options=None) >Thread-14::DEBUG::2014-09-04 21:04:27,150::__init__::225::IOProcess::(_processLogs) (844167) Got request for method 'statvfs' >Thread-14054::INFO::2014-09-04 21:04:27,156::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180c43ee-5baf-41b7-87c7-c0214b51fe8f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000329173', 'lastCheck': '10.8', 'valid': True}, '7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000467575', 'lastCheck': '11.0', 'valid': True}, '7ad04229-b793-4f73-ad10-5e41a4e836ff': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000328546', 'lastCheck': '11.1', 'valid': True}} >Thread-14::DEBUG::2014-09-04 21:04:27,158::__init__::225::IOProcess::(_processLogs) (844162) Got request for method 'access'DEBUG|(844167) Building response >Thread-14054::DEBUG::2014-09-04 21:04:27,162::task::1191::Storage.TaskManager.Task::(prepare) Task=`1ac46a9b-ae8d-473e-985d-5630fc743f12`::finished: {'180c43ee-5baf-41b7-87c7-c0214b51fe8f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000329173', 'lastCheck': '10.8', 'valid': True}, '7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000467575', 'lastCheck': '11.0', 'valid': True}, '7ad04229-b793-4f73-ad10-5e41a4e836ff': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000328546', 'lastCheck': '11.1', 'valid': True}} >Thread-14::DEBUG::2014-09-04 21:04:27,165::__init__::225::IOProcess::(_processLogs) (844167) Queuing response >Thread-43::DEBUG::2014-09-04 21:04:27,166::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.78390355-2a2d-41e5-aea5-fb426559f747`ReqID=`c25c7493-2c56-4710-b4d5-6f1f1344166f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-14054::DEBUG::2014-09-04 21:04:27,167::task::595::Storage.TaskManager.Task::(_updateState) Task=`1ac46a9b-ae8d-473e-985d-5630fc743f12`::moving from state preparing -> state finished >Thread-43::DEBUG::2014-09-04 21:04:27,170::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.78390355-2a2d-41e5-aea5-fb426559f747' for lock type 'shared' >Thread-14::DEBUG::2014-09-04 21:04:27,171::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14054::DEBUG::2014-09-04 21:04:27,172::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14054::DEBUG::2014-09-04 21:04:27,177::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-09-04 21:04:27,177::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-43::DEBUG::2014-09-04 21:04:27,179::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.78390355-2a2d-41e5-aea5-fb426559f747' is free. Now locking as 'shared' (1 active user) >Thread-14054::DEBUG::2014-09-04 21:04:27,182::task::993::Storage.TaskManager.Task::(_decref) Task=`1ac46a9b-ae8d-473e-985d-5630fc743f12`::ref 0 aborting False >Thread-43::DEBUG::2014-09-04 21:04:27,186::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.78390355-2a2d-41e5-aea5-fb426559f747`ReqID=`c25c7493-2c56-4710-b4d5-6f1f1344166f`::Granted request >Thread-43::DEBUG::2014-09-04 21:04:27,202::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`5fcd415f-a2a0-4013-832b-cf04bfc8b581`::_resourcesAcquired: Storage.78390355-2a2d-41e5-aea5-fb426559f747 (shared) >Thread-14::DEBUG::2014-09-04 21:04:27,207::__init__::225::IOProcess::(_processLogs) (844162) Got request for method 'access'DEBUG|Receiving request... >Thread-43::DEBUG::2014-09-04 21:04:27,210::task::993::Storage.TaskManager.Task::(_decref) Task=`5fcd415f-a2a0-4013-832b-cf04bfc8b581`::ref 1 aborting False >Thread-17::DEBUG::2014-09-04 21:04:27,211::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_artyom__storage__rhevm__35/180c43ee-5baf-41b7-87c7-c0214b51fe8f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-14::DEBUG::2014-09-04 21:04:27,217::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-14::DEBUG::2014-09-04 21:04:27,742::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-17::DEBUG::2014-09-04 21:04:27,747::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n474 bytes (474 B) copied, 0.000378914 s, 1.3 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-04 21:04:27,750::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-04 21:04:27,758::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:04:27,763::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:04:27,769::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:04:27,775::__init__::225::IOProcess::(_processLogs) (844168) Finding callback 'statvfs'... >Thread-14::DEBUG::2014-09-04 21:04:27,782::__init__::225::IOProcess::(_processLogs) (844168) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-04 21:04:27,789::__init__::225::IOProcess::(_processLogs) (844168) Building response >Thread-14::DEBUG::2014-09-04 21:04:27,794::__init__::225::IOProcess::(_processLogs) (844168) Queuing response >Thread-14::DEBUG::2014-09-04 21:04:27,801::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:04:27,806::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-14::DEBUG::2014-09-04 21:04:27,832::__init__::225::IOProcess::(_processLogs) Message size is 190 >Thread-14::DEBUG::2014-09-04 21:04:27,839::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:04:27,846::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-04 21:04:27,851::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:04:27,855::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:04:27,858::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:04:27,861::__init__::225::IOProcess::(_processLogs) (844169) Finding callback 'statvfs'... >Thread-14::DEBUG::2014-09-04 21:04:27,867::__init__::225::IOProcess::(_processLogs) (844169) Got request for method 'statvfs' >Thread-43::INFO::2014-09-04 21:04:27,870::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': u'/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_qa_shared__iso__domain/7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 8L, 'domains': '180c43ee-5baf-41b7-87c7-c0214b51fe8f:Active,7ad04229-b793-4f73-ad10-5e41a4e836ff:Active,7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6:Active', 'master_uuid': u'180c43ee-5baf-41b7-87c7-c0214b51fe8f', 'version': '3', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'180c43ee-5baf-41b7-87c7-c0214b51fe8f': {'status': 'Active', 'diskfree': '1820606267392', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246104576', 'version': 3}, '7ad04229-b793-4f73-ad10-5e41a4e836ff': {'status': 'Active', 'diskfree': '1820606267392', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246104576', 'version': 0}, '7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6': {'status': 'Active', 'diskfree': '18882756608', 'isoprefix': u'/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_qa_shared__iso__domain/7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '652611682304', 'version': 0}}} >Thread-14::DEBUG::2014-09-04 21:04:27,875::__init__::225::IOProcess::(_processLogs) (844169) Queuing response >Thread-43::DEBUG::2014-09-04 21:04:27,876::task::1191::Storage.TaskManager.Task::(prepare) Task=`5fcd415f-a2a0-4013-832b-cf04bfc8b581`::finished: {'info': {'name': 'No Description', 'isoprefix': u'/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_qa_shared__iso__domain/7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 8L, 'domains': '180c43ee-5baf-41b7-87c7-c0214b51fe8f:Active,7ad04229-b793-4f73-ad10-5e41a4e836ff:Active,7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6:Active', 'master_uuid': u'180c43ee-5baf-41b7-87c7-c0214b51fe8f', 'version': '3', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'180c43ee-5baf-41b7-87c7-c0214b51fe8f': {'status': 'Active', 'diskfree': '1820606267392', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246104576', 'version': 3}, '7ad04229-b793-4f73-ad10-5e41a4e836ff': {'status': 'Active', 'diskfree': '1820606267392', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246104576', 'version': 0}, '7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6': {'status': 'Active', 'diskfree': '18882756608', 'isoprefix': u'/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_qa_shared__iso__domain/7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '652611682304', 'version': 0}}} >Thread-14::DEBUG::2014-09-04 21:04:27,881::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-43::DEBUG::2014-09-04 21:04:27,881::task::595::Storage.TaskManager.Task::(_updateState) Task=`5fcd415f-a2a0-4013-832b-cf04bfc8b581`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-09-04 21:04:27,885::__init__::225::IOProcess::(_processLogs) Sending response sized 329 >Thread-43::DEBUG::2014-09-04 21:04:27,885::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.78390355-2a2d-41e5-aea5-fb426559f747': < ResourceRef 'Storage.78390355-2a2d-41e5-aea5-fb426559f747', isValid: 'True' obj: 'None'>} >Thread-43::DEBUG::2014-09-04 21:04:27,889::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-43::DEBUG::2014-09-04 21:04:27,896::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.78390355-2a2d-41e5-aea5-fb426559f747' >Thread-43::DEBUG::2014-09-04 21:04:27,905::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.78390355-2a2d-41e5-aea5-fb426559f747' (0 active users) >Thread-14::DEBUG::2014-09-04 21:04:27,908::__init__::225::IOProcess::(_processLogs) Message size is 166 >Thread-43::DEBUG::2014-09-04 21:04:27,913::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.78390355-2a2d-41e5-aea5-fb426559f747' is free, finding out if anyone is waiting for it. >Thread-14::DEBUG::2014-09-04 21:04:27,917::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-43::DEBUG::2014-09-04 21:04:27,919::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.78390355-2a2d-41e5-aea5-fb426559f747', Clearing records. >Thread-14::DEBUG::2014-09-04 21:04:27,923::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14054::DEBUG::2014-09-04 21:04:27,924::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >Thread-43::DEBUG::2014-09-04 21:04:27,928::task::993::Storage.TaskManager.Task::(_decref) Task=`5fcd415f-a2a0-4013-832b-cf04bfc8b581`::ref 0 aborting False >Thread-14::DEBUG::2014-09-04 21:04:27,929::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:04:27,934::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:04:27,939::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:04:27,945::__init__::225::IOProcess::(_processLogs) (844170) Finding callback 'statvfs'... >Thread-14054::DEBUG::2014-09-04 21:04:27,945::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >Thread-14::DEBUG::2014-09-04 21:04:27,949::__init__::225::IOProcess::(_processLogs) (844170) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-04 21:04:27,954::__init__::225::IOProcess::(_processLogs) (844170) Building response >Thread-14::DEBUG::2014-09-04 21:04:27,959::__init__::225::IOProcess::(_processLogs) (844170) Queuing response >Thread-14::DEBUG::2014-09-04 21:04:27,963::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:04:27,966::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-14::DEBUG::2014-09-04 21:04:27,984::__init__::225::IOProcess::(_processLogs) Message size is 183 >Thread-14::DEBUG::2014-09-04 21:04:27,988::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:04:27,991::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-04 21:04:27,994::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:04:27,997::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:04:28,001::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:04:28,004::__init__::225::IOProcess::(_processLogs) (844171) Finding callback 'access'... >Thread-14::DEBUG::2014-09-04 21:04:28,007::__init__::225::IOProcess::(_processLogs) (844171) Got request for method 'access' >Thread-14::DEBUG::2014-09-04 21:04:28,010::__init__::225::IOProcess::(_processLogs) (844171) Building response >Thread-14::DEBUG::2014-09-04 21:04:28,014::__init__::225::IOProcess::(_processLogs) (844171) Queuing response >Thread-14::DEBUG::2014-09-04 21:04:28,017::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:04:28,021::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-14::DEBUG::2014-09-04 21:04:28,028::__init__::225::IOProcess::(_processLogs) Message size is 187 >Thread-14::DEBUG::2014-09-04 21:04:28,030::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:04:28,032::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-04 21:04:28,034::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:04:28,036::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:04:28,042::__init__::225::IOProcess::(_processLogs) (844172) Finding callback 'access'... >Thread-14::DEBUG::2014-09-04 21:04:28,045::__init__::225::IOProcess::(_processLogs) (844172) Got request for method 'access' >Thread-14::DEBUG::2014-09-04 21:04:28,047::__init__::225::IOProcess::(_processLogs) (844172) Building response >Thread-14::DEBUG::2014-09-04 21:04:28,049::__init__::225::IOProcess::(_processLogs) (844172) Queuing response >Thread-14::DEBUG::2014-09-04 21:04:28,050::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:04:28,052::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-14::DEBUG::2014-09-04 21:04:28,058::__init__::225::IOProcess::(_processLogs) Message size is 189 >Thread-14::DEBUG::2014-09-04 21:04:28,060::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:04:28,062::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-04 21:04:28,064::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:04:28,066::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:04:28,069::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:04:28,072::__init__::225::IOProcess::(_processLogs) (844173) Finding callback 'access'... >Thread-14::DEBUG::2014-09-04 21:04:28,074::__init__::225::IOProcess::(_processLogs) (844173) Got request for method 'access' >Thread-14::DEBUG::2014-09-04 21:04:28,076::__init__::225::IOProcess::(_processLogs) (844173) Queuing response >Thread-14::DEBUG::2014-09-04 21:04:28,077::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:04:28,079::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-41::DEBUG::2014-09-04 21:04:30,237::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/78390355-2a2d-41e5-aea5-fb426559f747/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >GuestMonitor-numa__test::DEBUG::2014-09-04 21:04:30,576::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >GuestMonitor-quota__vm::DEBUG::2014-09-04 21:04:30,577::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >GuestMonitor-numa__test::DEBUG::2014-09-04 21:04:30,584::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >GuestMonitor-quota__vm::DEBUG::2014-09-04 21:04:30,587::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >GuestMonitor-numa__test::DEBUG::2014-09-04 21:04:30,597::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >GuestMonitor-quota__vm::DEBUG::2014-09-04 21:04:30,600::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >Dummy-41::DEBUG::2014-09-04 21:04:30,642::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0371926 s, 27.5 MB/s\n'; <rc> = 0 >Dummy-41::DEBUG::2014-09-04 21:04:32,653::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/78390355-2a2d-41e5-aea5-fb426559f747/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-41::DEBUG::2014-09-04 21:04:33,523::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.188502 s, 5.4 MB/s\n'; <rc> = 0 >Dummy-41::DEBUG::2014-09-04 21:04:35,542::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/78390355-2a2d-41e5-aea5-fb426559f747/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >VM Channels Listener::DEBUG::2014-09-04 21:04:35,876::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-09-04 21:04:35,883::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 57. >GuestMonitor-numa__test::DEBUG::2014-09-04 21:04:35,885::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >GuestMonitor-quota__vm::DEBUG::2014-09-04 21:04:35,885::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >GuestMonitor-numa__test::DEBUG::2014-09-04 21:04:35,897::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >GuestMonitor-quota__vm::DEBUG::2014-09-04 21:04:35,899::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >GuestMonitor-numa__test::DEBUG::2014-09-04 21:04:35,908::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >GuestMonitor-quota__vm::DEBUG::2014-09-04 21:04:35,911::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >Dummy-41::DEBUG::2014-09-04 21:04:35,953::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0448084 s, 22.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-04 21:04:37,850::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-14::DEBUG::2014-09-04 21:04:37,851::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:04:37,851::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:04:37,851::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:04:37,851::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:04:37,851::__init__::225::IOProcess::(_processLogs) (844174) Finding callback 'statvfs'... >Thread-14::DEBUG::2014-09-04 21:04:37,851::__init__::225::IOProcess::(_processLogs) (844174) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-04 21:04:37,851::__init__::225::IOProcess::(_processLogs) (844174) Queuing response >Thread-14::DEBUG::2014-09-04 21:04:37,852::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:04:37,852::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-10379::DEBUG::2014-09-04 21:04:37,853::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mavital/7ad04229-b793-4f73-ad10-5e41a4e836ff/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-09-04 21:04:38,182::domainMonitor::209::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 180c43ee-5baf-41b7-87c7-c0214b51fe8f >Dummy-41::DEBUG::2014-09-04 21:04:38,189::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/78390355-2a2d-41e5-aea5-fb426559f747/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-14054::DEBUG::2014-09-04 21:04:38,194::BindingXMLRPC::318::vds::(wrapper) client [10.35.163.104] >Thread-14::DEBUG::2014-09-04 21:04:38,195::__init__::225::IOProcess::(_processLogs) Message size is 190 >Thread-10379::DEBUG::2014-09-04 21:04:38,195::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n339 bytes (339 B) copied, 0.000334422 s, 1.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-04 21:04:38,526::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14054::DEBUG::2014-09-04 21:04:38,532::task::595::Storage.TaskManager.Task::(_updateState) Task=`7fc75ed6-bb56-4874-8e59-5145434ac1fa`::moving from state init -> state preparing >Thread-14::DEBUG::2014-09-04 21:04:38,539::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14054::INFO::2014-09-04 21:04:38,544::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='78390355-2a2d-41e5-aea5-fb426559f747', options=None) >Thread-14::DEBUG::2014-09-04 21:04:38,546::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:04:38,551::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:04:38,556::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:04:38,559::__init__::225::IOProcess::(_processLogs) (844175) Finding callback 'statvfs'... >Thread-14::DEBUG::2014-09-04 21:04:38,563::__init__::225::IOProcess::(_processLogs) (844175) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-04 21:04:38,568::__init__::225::IOProcess::(_processLogs) (844175) Queuing response >Thread-14::DEBUG::2014-09-04 21:04:38,572::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:04:38,577::__init__::225::IOProcess::(_processLogs) Sending response sized 329 >Thread-14::DEBUG::2014-09-04 21:04:38,597::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-18::DEBUG::2014-09-04 21:04:38,600::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_qa_shared__iso__domain/7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-14::DEBUG::2014-09-04 21:04:38,604::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:04:38,928::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-18::DEBUG::2014-09-04 21:04:39,124::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1618 bytes (1.6 kB) copied, 0.00132858 s, 1.2 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-04 21:04:39,127::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:04:39,133::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:04:39,135::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:04:39,137::__init__::225::IOProcess::(_processLogs) (844176) Finding callback 'glob'... >Thread-14::DEBUG::2014-09-04 21:04:39,139::__init__::225::IOProcess::(_processLogs) (844176) Got request for method 'glob' >Thread-14::DEBUG::2014-09-04 21:04:39,142::__init__::225::IOProcess::(_processLogs) (844176) Queuing response >Thread-14::DEBUG::2014-09-04 21:04:39,180::__init__::225::IOProcess::(_processLogs) Generating json... >Dummy-41::DEBUG::2014-09-04 21:04:39,180::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.624277 s, 1.6 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-04 21:04:39,182::__init__::225::IOProcess::(_processLogs) Sending response sized 220 >Thread-14::DEBUG::2014-09-04 21:04:39,191::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-14::DEBUG::2014-09-04 21:04:39,193::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:04:39,195::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-04 21:04:39,197::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:04:39,199::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:04:39,203::__init__::225::IOProcess::(_processLogs) (844177) Finding callback 'statvfs'... >Thread-14::DEBUG::2014-09-04 21:04:39,205::__init__::225::IOProcess::(_processLogs) (844177) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-04 21:04:39,207::__init__::225::IOProcess::(_processLogs) (844177) Building response >Thread-14::DEBUG::2014-09-04 21:04:39,209::__init__::225::IOProcess::(_processLogs) (844177) Queuing response >Thread-14::DEBUG::2014-09-04 21:04:39,211::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:04:39,213::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-14::DEBUG::2014-09-04 21:04:39,221::__init__::225::IOProcess::(_processLogs) Message size is 127 >Thread-14::DEBUG::2014-09-04 21:04:39,226::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:04:39,228::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-04 21:04:39,230::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:04:39,233::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:04:39,235::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:04:39,236::__init__::225::IOProcess::(_processLogs) (844178) Finding callback 'glob'... >Thread-14::DEBUG::2014-09-04 21:04:39,238::__init__::225::IOProcess::(_processLogs) (844178) Got request for method 'glob' >Thread-14::DEBUG::2014-09-04 21:04:39,240::__init__::225::IOProcess::(_processLogs) (844178) Building response >Thread-14::DEBUG::2014-09-04 21:04:39,242::__init__::225::IOProcess::(_processLogs) (844178) Queuing response >Thread-14::DEBUG::2014-09-04 21:04:39,244::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:04:39,246::__init__::225::IOProcess::(_processLogs) Sending response sized 177 >Thread-14::DEBUG::2014-09-04 21:04:39,254::__init__::225::IOProcess::(_processLogs) Message size is 146 >Thread-14::DEBUG::2014-09-04 21:04:39,256::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:04:39,258::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-04 21:04:39,260::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:04:39,262::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:04:39,265::__init__::225::IOProcess::(_processLogs) (844179) Finding callback 'glob'... >Thread-14::DEBUG::2014-09-04 21:04:39,266::__init__::225::IOProcess::(_processLogs) (844179) Got request for method 'glob' >Thread-14::DEBUG::2014-09-04 21:04:39,267::__init__::225::IOProcess::(_processLogs) (844179) Building response >Thread-14::DEBUG::2014-09-04 21:04:39,268::__init__::225::IOProcess::(_processLogs) (844179) Queuing response >Thread-14::DEBUG::2014-09-04 21:04:39,269::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:04:39,271::__init__::225::IOProcess::(_processLogs) Sending response sized 196 >Thread-14::DEBUG::2014-09-04 21:04:39,437::__init__::225::IOProcess::(_processLogs) Message size is 190 >Thread-14::DEBUG::2014-09-04 21:04:39,443::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:04:39,447::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-04 21:04:39,451::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:04:39,455::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:04:39,460::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:04:39,464::__init__::225::IOProcess::(_processLogs) (844180) Finding callback 'statvfs'... >Thread-14::DEBUG::2014-09-04 21:04:39,468::__init__::225::IOProcess::(_processLogs) (844180) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-04 21:04:39,473::__init__::225::IOProcess::(_processLogs) (844180) Building response >Thread-14::DEBUG::2014-09-04 21:04:39,477::__init__::225::IOProcess::(_processLogs) (844180) Queuing response >Thread-14::DEBUG::2014-09-04 21:04:39,481::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:04:39,485::__init__::225::IOProcess::(_processLogs) Sending response sized 329 >Thread-17::DEBUG::2014-09-04 21:04:39,507::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_artyom__storage__rhevm__35/180c43ee-5baf-41b7-87c7-c0214b51fe8f >Thread-14::DEBUG::2014-09-04 21:04:39,515::__init__::225::IOProcess::(_processLogs) Message size is 175 >Thread-14::DEBUG::2014-09-04 21:04:39,518::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:04:39,520::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-04 21:04:39,523::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:04:39,526::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:04:39,529::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:04:39,531::__init__::225::IOProcess::(_processLogs) (844181) Finding callback 'touch'... >Thread-14::DEBUG::2014-09-04 21:04:39,535::__init__::225::IOProcess::(_processLogs) (844181) Building response >Thread-14::DEBUG::2014-09-04 21:04:39,538::__init__::225::IOProcess::(_processLogs) (844181) Queuing response >Thread-14::DEBUG::2014-09-04 21:04:39,540::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:04:39,543::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-17::DEBUG::2014-09-04 21:04:39,550::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-14::DEBUG::2014-09-04 21:04:39,556::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-14::DEBUG::2014-09-04 21:04:39,559::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:04:39,562::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-04 21:04:39,565::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:04:39,567::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:04:39,570::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:04:39,573::__init__::225::IOProcess::(_processLogs) (844182) Finding callback 'readfile'... >Thread-14::DEBUG::2014-09-04 21:04:39,575::__init__::225::IOProcess::(_processLogs) (844182) Got request for method 'readfile' >Thread-14::DEBUG::2014-09-04 21:04:39,579::__init__::225::IOProcess::(_processLogs) (844182) Queuing response >Thread-14::DEBUG::2014-09-04 21:04:39,582::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:04:39,584::__init__::225::IOProcess::(_processLogs) Sending response sized 706 >Thread-17::DEBUG::2014-09-04 21:04:39,590::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=st_35', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=dc_35', 'POOL_DOMAINS=180c43ee-5baf-41b7-87c7-c0214b51fe8f:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=-1', 'POOL_UUID=78390355-2a2d-41e5-aea5-fb426559f747', 'REMOTE_PATH=10.35.160.108:/RHEV/artyom_storage_rhevm_35', 'ROLE=Master', 'SDUUID=180c43ee-5baf-41b7-87c7-c0214b51fe8f', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=fd41e7dbe51776724e2becb466900c4c3bdb24ac'] >Thread-14::DEBUG::2014-09-04 21:04:39,601::__init__::225::IOProcess::(_processLogs) Message size is 192 >Thread-14::DEBUG::2014-09-04 21:04:39,604::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:04:39,606::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-04 21:04:39,609::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:04:39,612::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:04:39,616::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:04:39,618::__init__::225::IOProcess::(_processLogs) (844183) Finding callback 'access'... >Thread-14::DEBUG::2014-09-04 21:04:39,621::__init__::225::IOProcess::(_processLogs) (844183) Got request for method 'access' >Thread-14::DEBUG::2014-09-04 21:04:39,624::__init__::225::IOProcess::(_processLogs) (844183) Building response >Thread-14::DEBUG::2014-09-04 21:04:39,626::__init__::225::IOProcess::(_processLogs) (844183) Queuing response >Thread-14::DEBUG::2014-09-04 21:04:39,629::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:04:39,632::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-14::DEBUG::2014-09-04 21:04:39,642::__init__::225::IOProcess::(_processLogs) Message size is 186 >Thread-14::DEBUG::2014-09-04 21:04:39,644::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:04:39,647::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-04 21:04:39,650::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:04:39,653::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:04:39,655::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:04:39,658::__init__::225::IOProcess::(_processLogs) (844184) Finding callback 'glob'... >Thread-14::DEBUG::2014-09-04 21:04:39,661::__init__::225::IOProcess::(_processLogs) (844184) Got request for method 'glob' >Thread-14::DEBUG::2014-09-04 21:04:39,664::__init__::225::IOProcess::(_processLogs) (844184) Queuing response >Thread-14::DEBUG::2014-09-04 21:04:39,667::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:04:39,669::__init__::225::IOProcess::(_processLogs) Sending response sized 78 >Thread-17::DEBUG::2014-09-04 21:04:39,675::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-17::INFO::2014-09-04 21:04:39,677::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180c43ee-5baf-41b7-87c7-c0214b51fe8f_imageNS already registered >Thread-17::INFO::2014-09-04 21:04:39,679::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180c43ee-5baf-41b7-87c7-c0214b51fe8f_volumeNS already registered >Thread-14::DEBUG::2014-09-04 21:04:39,687::__init__::225::IOProcess::(_processLogs) Message size is 166 >Thread-14::DEBUG::2014-09-04 21:04:39,689::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:04:39,692::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-04 21:04:39,695::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14054::INFO::2014-09-04 21:04:39,695::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 8L}} >Thread-14::DEBUG::2014-09-04 21:04:39,699::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14054::DEBUG::2014-09-04 21:04:39,700::task::1191::Storage.TaskManager.Task::(prepare) Task=`7fc75ed6-bb56-4874-8e59-5145434ac1fa`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 8L}} >Thread-14::DEBUG::2014-09-04 21:04:39,702::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14054::DEBUG::2014-09-04 21:04:39,703::task::595::Storage.TaskManager.Task::(_updateState) Task=`7fc75ed6-bb56-4874-8e59-5145434ac1fa`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-09-04 21:04:39,706::__init__::225::IOProcess::(_processLogs) (844185) Finding callback 'statvfs'... >Thread-14054::DEBUG::2014-09-04 21:04:39,707::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-09-04 21:04:39,710::__init__::225::IOProcess::(_processLogs) (844185) Got request for method 'statvfs' >Thread-14054::DEBUG::2014-09-04 21:04:39,710::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-09-04 21:04:39,715::__init__::225::IOProcess::(_processLogs) (844185) Queuing response >Thread-14054::DEBUG::2014-09-04 21:04:39,715::task::993::Storage.TaskManager.Task::(_decref) Task=`7fc75ed6-bb56-4874-8e59-5145434ac1fa`::ref 0 aborting False >Thread-14::DEBUG::2014-09-04 21:04:39,718::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:04:39,723::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-17::DEBUG::2014-09-04 21:04:39,737::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_artyom__storage__rhevm__35/180c43ee-5baf-41b7-87c7-c0214b51fe8f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-43::DEBUG::2014-09-04 21:04:40,081::BindingXMLRPC::318::vds::(wrapper) client [10.35.163.104] >Thread-17::DEBUG::2014-09-04 21:04:40,081::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n474 bytes (474 B) copied, 0.000334755 s, 1.4 MB/s\n'; <rc> = 0 >Thread-43::DEBUG::2014-09-04 21:04:40,089::task::595::Storage.TaskManager.Task::(_updateState) Task=`3b3f8dfa-af85-4514-b139-218919dfd312`::moving from state init -> state preparing >Thread-14::DEBUG::2014-09-04 21:04:40,091::__init__::225::IOProcess::(_processLogs) Message size is 166 >Thread-43::INFO::2014-09-04 21:04:40,094::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='78390355-2a2d-41e5-aea5-fb426559f747', options=None) >Thread-14::DEBUG::2014-09-04 21:04:40,095::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:04:40,100::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-04 21:04:40,103::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-43::DEBUG::2014-09-04 21:04:40,103::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.78390355-2a2d-41e5-aea5-fb426559f747`ReqID=`8316e58c-08b6-4577-9255-9ae907a70089`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-43::DEBUG::2014-09-04 21:04:40,106::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.78390355-2a2d-41e5-aea5-fb426559f747' for lock type 'shared' >Thread-14::DEBUG::2014-09-04 21:04:40,106::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:04:40,110::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-43::DEBUG::2014-09-04 21:04:40,111::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.78390355-2a2d-41e5-aea5-fb426559f747' is free. Now locking as 'shared' (1 active user) >Thread-14::DEBUG::2014-09-04 21:04:40,114::__init__::225::IOProcess::(_processLogs) (844186) Finding callback 'statvfs'... >Thread-43::DEBUG::2014-09-04 21:04:40,114::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.78390355-2a2d-41e5-aea5-fb426559f747`ReqID=`8316e58c-08b6-4577-9255-9ae907a70089`::Granted request >Thread-14::DEBUG::2014-09-04 21:04:40,117::__init__::225::IOProcess::(_processLogs) (844186) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-04 21:04:40,121::__init__::225::IOProcess::(_processLogs) (844186) Queuing response >Thread-43::DEBUG::2014-09-04 21:04:40,123::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`3b3f8dfa-af85-4514-b139-218919dfd312`::_resourcesAcquired: Storage.78390355-2a2d-41e5-aea5-fb426559f747 (shared) >Thread-14::DEBUG::2014-09-04 21:04:40,125::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-43::DEBUG::2014-09-04 21:04:40,127::task::993::Storage.TaskManager.Task::(_decref) Task=`3b3f8dfa-af85-4514-b139-218919dfd312`::ref 1 aborting False >Thread-14::DEBUG::2014-09-04 21:04:40,128::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-14::DEBUG::2014-09-04 21:04:40,156::__init__::225::IOProcess::(_processLogs) Message size is 183 >Thread-14::DEBUG::2014-09-04 21:04:40,162::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:04:40,166::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-04 21:04:40,170::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:04:40,174::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:04:40,178::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:04:40,181::__init__::225::IOProcess::(_processLogs) (844187) Finding callback 'access'... >Thread-14::DEBUG::2014-09-04 21:04:40,185::__init__::225::IOProcess::(_processLogs) (844187) Got request for method 'access' >Thread-14::DEBUG::2014-09-04 21:04:40,190::__init__::225::IOProcess::(_processLogs) (844187) Building response >Thread-9196::DEBUG::2014-09-04 21:04:40,196::task::595::Storage.TaskManager.Task::(_updateState) Task=`70eba76f-4956-4ec9-a80b-458678fd4bd6`::moving from state init -> state preparing >Thread-14::DEBUG::2014-09-04 21:04:40,196::__init__::225::IOProcess::(_processLogs) (844187) Queuing response >Thread-9196::INFO::2014-09-04 21:04:40,202::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='180c43ee-5baf-41b7-87c7-c0214b51fe8f', spUUID='78390355-2a2d-41e5-aea5-fb426559f747', imgUUID='e8bb0473-2d86-4f1c-9d82-2c9690c52427', volUUID='bed5a4ba-eae0-49bf-a6b2-be81e7c21100', options=None) >Thread-14::DEBUG::2014-09-04 21:04:40,203::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:04:40,209::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-14::DEBUG::2014-09-04 21:04:40,222::__init__::225::IOProcess::(_processLogs) Message size is 244 >Thread-14::DEBUG::2014-09-04 21:04:40,224::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:04:40,226::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-04 21:04:40,228::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:04:40,231::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:04:40,232::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:04:40,236::__init__::225::IOProcess::(_processLogs) (844188) Finding callback 'stat'... >Thread-43::INFO::2014-09-04 21:04:40,237::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': u'/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_qa_shared__iso__domain/7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 8L, 'domains': '180c43ee-5baf-41b7-87c7-c0214b51fe8f:Active,7ad04229-b793-4f73-ad10-5e41a4e836ff:Active,7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6:Active', 'master_uuid': u'180c43ee-5baf-41b7-87c7-c0214b51fe8f', 'version': '3', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'180c43ee-5baf-41b7-87c7-c0214b51fe8f': {'status': 'Active', 'diskfree': '1820606201856', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246104576', 'version': 3}, '7ad04229-b793-4f73-ad10-5e41a4e836ff': {'status': 'Active', 'diskfree': '1820606201856', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246104576', 'version': 0}, '7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6': {'status': 'Active', 'diskfree': '18882756608', 'isoprefix': u'/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_qa_shared__iso__domain/7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '652611682304', 'version': 0}}} >Thread-14::DEBUG::2014-09-04 21:04:40,239::__init__::225::IOProcess::(_processLogs) (844188) Got request for method 'stat' >Thread-43::DEBUG::2014-09-04 21:04:40,241::task::1191::Storage.TaskManager.Task::(prepare) Task=`3b3f8dfa-af85-4514-b139-218919dfd312`::finished: {'info': {'name': 'No Description', 'isoprefix': u'/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_qa_shared__iso__domain/7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 8L, 'domains': '180c43ee-5baf-41b7-87c7-c0214b51fe8f:Active,7ad04229-b793-4f73-ad10-5e41a4e836ff:Active,7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6:Active', 'master_uuid': u'180c43ee-5baf-41b7-87c7-c0214b51fe8f', 'version': '3', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'180c43ee-5baf-41b7-87c7-c0214b51fe8f': {'status': 'Active', 'diskfree': '1820606201856', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246104576', 'version': 3}, '7ad04229-b793-4f73-ad10-5e41a4e836ff': {'status': 'Active', 'diskfree': '1820606201856', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246104576', 'version': 0}, '7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6': {'status': 'Active', 'diskfree': '18882756608', 'isoprefix': u'/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_qa_shared__iso__domain/7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '652611682304', 'version': 0}}} >Thread-14::DEBUG::2014-09-04 21:04:40,243::__init__::225::IOProcess::(_processLogs) (844188) Queuing response >Thread-43::DEBUG::2014-09-04 21:04:40,244::task::595::Storage.TaskManager.Task::(_updateState) Task=`3b3f8dfa-af85-4514-b139-218919dfd312`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-09-04 21:04:40,246::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-43::DEBUG::2014-09-04 21:04:40,247::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.78390355-2a2d-41e5-aea5-fb426559f747': < ResourceRef 'Storage.78390355-2a2d-41e5-aea5-fb426559f747', isValid: 'True' obj: 'None'>} >Thread-14::DEBUG::2014-09-04 21:04:40,250::__init__::225::IOProcess::(_processLogs) Sending response sized 327 >Thread-43::DEBUG::2014-09-04 21:04:40,250::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-43::DEBUG::2014-09-04 21:04:40,256::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.78390355-2a2d-41e5-aea5-fb426559f747' >Thread-43::DEBUG::2014-09-04 21:04:40,262::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.78390355-2a2d-41e5-aea5-fb426559f747' (0 active users) >Thread-14::DEBUG::2014-09-04 21:04:40,264::__init__::225::IOProcess::(_processLogs) Message size is 187 >Thread-43::DEBUG::2014-09-04 21:04:40,266::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.78390355-2a2d-41e5-aea5-fb426559f747' is free, finding out if anyone is waiting for it. >Thread-14::DEBUG::2014-09-04 21:04:40,268::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-43::DEBUG::2014-09-04 21:04:40,269::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.78390355-2a2d-41e5-aea5-fb426559f747', Clearing records. >Thread-14::DEBUG::2014-09-04 21:04:40,272::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-04 21:04:40,275::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-43::DEBUG::2014-09-04 21:04:40,275::task::993::Storage.TaskManager.Task::(_decref) Task=`3b3f8dfa-af85-4514-b139-218919dfd312`::ref 0 aborting False >Thread-14::DEBUG::2014-09-04 21:04:40,278::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:04:40,282::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:04:40,285::__init__::225::IOProcess::(_processLogs) (844189) Finding callback 'access'... >Thread-14::DEBUG::2014-09-04 21:04:40,288::__init__::225::IOProcess::(_processLogs) (844189) Got request for method 'access' >Thread-14::DEBUG::2014-09-04 21:04:40,291::__init__::225::IOProcess::(_processLogs) (844189) Building response >Thread-14::DEBUG::2014-09-04 21:04:40,295::__init__::225::IOProcess::(_processLogs) (844189) Queuing response >Thread-14::DEBUG::2014-09-04 21:04:40,297::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:04:40,299::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-14::DEBUG::2014-09-04 21:04:40,305::__init__::225::IOProcess::(_processLogs) Message size is 244 >Thread-14::DEBUG::2014-09-04 21:04:40,307::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:04:40,309::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-04 21:04:40,311::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:04:40,313::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:04:40,314::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:04:40,316::__init__::225::IOProcess::(_processLogs) (844190) Finding callback 'stat'... >Thread-14::DEBUG::2014-09-04 21:04:40,318::__init__::225::IOProcess::(_processLogs) (844190) Got request for method 'stat' >Thread-14::DEBUG::2014-09-04 21:04:40,319::__init__::225::IOProcess::(_processLogs) (844190) Building response >Thread-14::DEBUG::2014-09-04 21:04:40,321::__init__::225::IOProcess::(_processLogs) (844190) Queuing response >Thread-14::DEBUG::2014-09-04 21:04:40,323::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:04:40,326::__init__::225::IOProcess::(_processLogs) Sending response sized 327 >Thread-9196::INFO::2014-09-04 21:04:40,333::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '24576', 'apparentsize': '1073741824'} >Thread-14::DEBUG::2014-09-04 21:04:40,337::__init__::225::IOProcess::(_processLogs) Message size is 189 >Thread-9196::DEBUG::2014-09-04 21:04:40,337::task::1191::Storage.TaskManager.Task::(prepare) Task=`70eba76f-4956-4ec9-a80b-458678fd4bd6`::finished: {'truesize': '24576', 'apparentsize': '1073741824'} >Thread-14::DEBUG::2014-09-04 21:04:40,340::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-9196::DEBUG::2014-09-04 21:04:40,341::task::595::Storage.TaskManager.Task::(_updateState) Task=`70eba76f-4956-4ec9-a80b-458678fd4bd6`::moving from state preparing -> state finished >Thread-9196::DEBUG::2014-09-04 21:04:40,344::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-09-04 21:04:40,344::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-9196::DEBUG::2014-09-04 21:04:40,347::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-09-04 21:04:40,349::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-9196::DEBUG::2014-09-04 21:04:40,351::task::993::Storage.TaskManager.Task::(_decref) Task=`70eba76f-4956-4ec9-a80b-458678fd4bd6`::ref 0 aborting False >Thread-14::DEBUG::2014-09-04 21:04:40,352::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:04:40,355::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:04:40,357::__init__::225::IOProcess::(_processLogs) (844191) Finding callback 'access'... >Thread-14::DEBUG::2014-09-04 21:04:40,359::__init__::225::IOProcess::(_processLogs) (844191) Got request for method 'access' >Thread-14::DEBUG::2014-09-04 21:04:40,362::__init__::225::IOProcess::(_processLogs) (844191) Building response >Thread-14::DEBUG::2014-09-04 21:04:40,364::__init__::225::IOProcess::(_processLogs) (844191) Queuing response >Thread-14::DEBUG::2014-09-04 21:04:40,367::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:04:40,368::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >GuestMonitor-numa__test::DEBUG::2014-09-04 21:04:40,928::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >GuestMonitor-quota__vm::DEBUG::2014-09-04 21:04:40,928::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >GuestMonitor-numa__test::DEBUG::2014-09-04 21:04:40,933::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >GuestMonitor-quota__vm::DEBUG::2014-09-04 21:04:40,934::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >GuestMonitor-numa__test::DEBUG::2014-09-04 21:04:40,938::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >GuestMonitor-quota__vm::DEBUG::2014-09-04 21:04:40,939::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >Dummy-41::DEBUG::2014-09-04 21:04:42,394::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/78390355-2a2d-41e5-aea5-fb426559f747/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-41::DEBUG::2014-09-04 21:04:42,753::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.01275 s, 80.3 MB/s\n'; <rc> = 0 >Thread-14054::DEBUG::2014-09-04 21:04:43,176::task::595::Storage.TaskManager.Task::(_updateState) Task=`3014cd03-df57-4202-9f3c-ca75e0f82e00`::moving from state init -> state preparing >Thread-14054::INFO::2014-09-04 21:04:43,177::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14054::INFO::2014-09-04 21:04:43,177::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180c43ee-5baf-41b7-87c7-c0214b51fe8f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000334755', 'lastCheck': '2.8', 'valid': True}, '7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00132858', 'lastCheck': '3.7', 'valid': True}, '7ad04229-b793-4f73-ad10-5e41a4e836ff': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000334422', 'lastCheck': '4.0', 'valid': True}} >Thread-14054::DEBUG::2014-09-04 21:04:43,177::task::1191::Storage.TaskManager.Task::(prepare) Task=`3014cd03-df57-4202-9f3c-ca75e0f82e00`::finished: {'180c43ee-5baf-41b7-87c7-c0214b51fe8f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000334755', 'lastCheck': '2.8', 'valid': True}, '7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00132858', 'lastCheck': '3.7', 'valid': True}, '7ad04229-b793-4f73-ad10-5e41a4e836ff': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000334422', 'lastCheck': '4.0', 'valid': True}} >Thread-14054::DEBUG::2014-09-04 21:04:43,177::task::595::Storage.TaskManager.Task::(_updateState) Task=`3014cd03-df57-4202-9f3c-ca75e0f82e00`::moving from state preparing -> state finished >Thread-14054::DEBUG::2014-09-04 21:04:43,177::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14054::DEBUG::2014-09-04 21:04:43,177::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14054::DEBUG::2014-09-04 21:04:43,178::task::993::Storage.TaskManager.Task::(_decref) Task=`3014cd03-df57-4202-9f3c-ca75e0f82e00`::ref 0 aborting False >Thread-14054::DEBUG::2014-09-04 21:04:43,199::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >Thread-14054::DEBUG::2014-09-04 21:04:43,200::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >Dummy-41::DEBUG::2014-09-04 21:04:44,807::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/78390355-2a2d-41e5-aea5-fb426559f747/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-41::DEBUG::2014-09-04 21:04:45,407::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.22604 s, 4.5 MB/s\n'; <rc> = 0 >GuestMonitor-quota__vm::DEBUG::2014-09-04 21:04:45,943::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >GuestMonitor-quota__vm::DEBUG::2014-09-04 21:04:45,944::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >GuestMonitor-quota__vm::DEBUG::2014-09-04 21:04:45,945::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >GuestMonitor-numa__test::DEBUG::2014-09-04 21:04:45,950::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >GuestMonitor-numa__test::DEBUG::2014-09-04 21:04:45,951::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >GuestMonitor-numa__test::DEBUG::2014-09-04 21:04:45,951::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >Thread-9209::DEBUG::2014-09-04 21:04:46,232::task::595::Storage.TaskManager.Task::(_updateState) Task=`e93121c7-e86b-4dcc-8c5b-c104272a35e1`::moving from state init -> state preparing >Thread-9209::INFO::2014-09-04 21:04:46,232::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='180c43ee-5baf-41b7-87c7-c0214b51fe8f', spUUID='78390355-2a2d-41e5-aea5-fb426559f747', imgUUID='70069763-69d2-42a9-86e7-23db8019e0b3', volUUID='0f679bfe-49c1-4e90-b02a-4f075a42fda5', options=None) >Thread-14::DEBUG::2014-09-04 21:04:46,233::__init__::225::IOProcess::(_processLogs) Message size is 244 >Thread-14::DEBUG::2014-09-04 21:04:46,233::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-04 21:04:46,233::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:04:46,234::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:04:46,234::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:04:46,234::__init__::225::IOProcess::(_processLogs) (844192) Finding callback 'stat'... >Thread-14::DEBUG::2014-09-04 21:04:46,234::__init__::225::IOProcess::(_processLogs) (844192) Got request for method 'stat' >Thread-14::DEBUG::2014-09-04 21:04:46,234::__init__::225::IOProcess::(_processLogs) (844192) Queuing response >Thread-14::DEBUG::2014-09-04 21:04:46,234::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:04:46,234::__init__::225::IOProcess::(_processLogs) Sending response sized 327 >Thread-14::DEBUG::2014-09-04 21:04:46,235::__init__::225::IOProcess::(_processLogs) Message size is 244 >Thread-14::DEBUG::2014-09-04 21:04:46,236::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:04:46,236::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:04:46,236::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:04:46,236::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:04:46,236::__init__::225::IOProcess::(_processLogs) (844193) Finding callback 'stat'... >Thread-14::DEBUG::2014-09-04 21:04:46,236::__init__::225::IOProcess::(_processLogs) (844193) Got request for method 'stat' >Thread-14::DEBUG::2014-09-04 21:04:46,236::__init__::225::IOProcess::(_processLogs) (844193) Building response >Thread-14::DEBUG::2014-09-04 21:04:46,236::__init__::225::IOProcess::(_processLogs) (844193) Queuing response >Thread-14::DEBUG::2014-09-04 21:04:46,237::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:04:46,237::__init__::225::IOProcess::(_processLogs) Sending response sized 327 >Thread-9209::INFO::2014-09-04 21:04:46,237::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '24576', 'apparentsize': '1073741824'} >Thread-9209::DEBUG::2014-09-04 21:04:46,237::task::1191::Storage.TaskManager.Task::(prepare) Task=`e93121c7-e86b-4dcc-8c5b-c104272a35e1`::finished: {'truesize': '24576', 'apparentsize': '1073741824'} >Thread-9209::DEBUG::2014-09-04 21:04:46,238::task::595::Storage.TaskManager.Task::(_updateState) Task=`e93121c7-e86b-4dcc-8c5b-c104272a35e1`::moving from state preparing -> state finished >Thread-9209::DEBUG::2014-09-04 21:04:46,240::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-9209::DEBUG::2014-09-04 21:04:46,241::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-9209::DEBUG::2014-09-04 21:04:46,242::task::993::Storage.TaskManager.Task::(_decref) Task=`e93121c7-e86b-4dcc-8c5b-c104272a35e1`::ref 0 aborting False >Dummy-41::DEBUG::2014-09-04 21:04:47,422::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/78390355-2a2d-41e5-aea5-fb426559f747/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-41::DEBUG::2014-09-04 21:04:47,787::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0126305 s, 81.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-04 21:04:49,229::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-14::DEBUG::2014-09-04 21:04:49,229::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:04:49,230::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:04:49,230::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:04:49,230::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:04:49,230::__init__::225::IOProcess::(_processLogs) (844194) Finding callback 'statvfs'... >Thread-14::DEBUG::2014-09-04 21:04:49,230::__init__::225::IOProcess::(_processLogs) (844194) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-04 21:04:49,230::__init__::225::IOProcess::(_processLogs) (844194) Queuing response >Thread-14::DEBUG::2014-09-04 21:04:49,230::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:04:49,231::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-10379::DEBUG::2014-09-04 21:04:49,232::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mavital/7ad04229-b793-4f73-ad10-5e41a4e836ff/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-10379::DEBUG::2014-09-04 21:04:49,569::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n339 bytes (339 B) copied, 0.000314504 s, 1.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-04 21:04:49,569::__init__::225::IOProcess::(_processLogs) Message size is 190 >Thread-14::DEBUG::2014-09-04 21:04:49,575::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:04:49,579::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-04 21:04:49,583::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:04:49,584::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:04:49,585::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:04:49,586::__init__::225::IOProcess::(_processLogs) (844195) Finding callback 'statvfs'... >Thread-14::DEBUG::2014-09-04 21:04:49,588::__init__::225::IOProcess::(_processLogs) (844195) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-04 21:04:49,589::__init__::225::IOProcess::(_processLogs) (844195) Queuing response >Thread-14::DEBUG::2014-09-04 21:04:49,590::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:04:49,591::__init__::225::IOProcess::(_processLogs) Sending response sized 329 >Thread-14::DEBUG::2014-09-04 21:04:49,598::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-09-04 21:04:49,600::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_qa_shared__iso__domain/7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-14::DEBUG::2014-09-04 21:04:49,601::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:04:49,938::__init__::225::IOProcess::(_processLogs) Queuing request... >Dummy-41::DEBUG::2014-09-04 21:04:49,940::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/78390355-2a2d-41e5-aea5-fb426559f747/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-14::DEBUG::2014-09-04 21:04:49,943::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-09-04 21:04:50,267::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1618 bytes (1.6 kB) copied, 0.00047906 s, 3.4 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-04 21:04:50,269::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:04:50,271::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:04:50,271::__init__::225::IOProcess::(_processLogs) (844196) Finding callback 'statvfs'... >Thread-14::DEBUG::2014-09-04 21:04:50,271::__init__::225::IOProcess::(_processLogs) (844196) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-04 21:04:50,271::__init__::225::IOProcess::(_processLogs) (844196) Queuing response >Thread-14::DEBUG::2014-09-04 21:04:50,271::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:04:50,272::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-14::DEBUG::2014-09-04 21:04:50,273::__init__::225::IOProcess::(_processLogs) Message size is 190 >Thread-14::DEBUG::2014-09-04 21:04:50,274::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:04:50,276::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-04 21:04:50,277::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:04:50,278::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:04:50,279::__init__::225::IOProcess::(_processLogs) (844197) Finding callback 'statvfs'... >Thread-14::DEBUG::2014-09-04 21:04:50,280::__init__::225::IOProcess::(_processLogs) (844197) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-04 21:04:50,280::__init__::225::IOProcess::(_processLogs) (844197) Building response >Thread-14::DEBUG::2014-09-04 21:04:50,281::__init__::225::IOProcess::(_processLogs) (844197) Queuing response >Thread-14::DEBUG::2014-09-04 21:04:50,282::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:04:50,283::__init__::225::IOProcess::(_processLogs) Sending response sized 329 >Dummy-41::DEBUG::2014-09-04 21:04:50,327::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0247531 s, 41.4 MB/s\n'; <rc> = 0 >Thread-14054::DEBUG::2014-09-04 21:04:50,328::BindingXMLRPC::318::vds::(wrapper) client [10.35.163.104] >Thread-14054::DEBUG::2014-09-04 21:04:50,331::task::595::Storage.TaskManager.Task::(_updateState) Task=`a921c08b-5148-49b6-8b10-9e821b4a123e`::moving from state init -> state preparing >Thread-14054::INFO::2014-09-04 21:04:50,332::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='78390355-2a2d-41e5-aea5-fb426559f747', options=None) >Thread-14054::INFO::2014-09-04 21:04:50,347::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 8L}} >Thread-14054::DEBUG::2014-09-04 21:04:50,348::task::1191::Storage.TaskManager.Task::(prepare) Task=`a921c08b-5148-49b6-8b10-9e821b4a123e`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 8L}} >Thread-14054::DEBUG::2014-09-04 21:04:50,348::task::595::Storage.TaskManager.Task::(_updateState) Task=`a921c08b-5148-49b6-8b10-9e821b4a123e`::moving from state preparing -> state finished >Thread-14054::DEBUG::2014-09-04 21:04:50,348::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14054::DEBUG::2014-09-04 21:04:50,348::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14054::DEBUG::2014-09-04 21:04:50,348::task::993::Storage.TaskManager.Task::(_decref) Task=`a921c08b-5148-49b6-8b10-9e821b4a123e`::ref 0 aborting False >Thread-43::DEBUG::2014-09-04 21:04:50,361::BindingXMLRPC::318::vds::(wrapper) client [10.35.163.104] >Thread-43::DEBUG::2014-09-04 21:04:50,362::task::595::Storage.TaskManager.Task::(_updateState) Task=`f0b2e047-df11-4134-acf2-9f3db92123e9`::moving from state init -> state preparing >Thread-43::INFO::2014-09-04 21:04:50,362::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='78390355-2a2d-41e5-aea5-fb426559f747', options=None) >Thread-43::DEBUG::2014-09-04 21:04:50,364::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.78390355-2a2d-41e5-aea5-fb426559f747`ReqID=`c1a3fa2e-d76e-4086-8f87-cd40c0c843d7`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-43::DEBUG::2014-09-04 21:04:50,365::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.78390355-2a2d-41e5-aea5-fb426559f747' for lock type 'shared' >Thread-43::DEBUG::2014-09-04 21:04:50,365::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.78390355-2a2d-41e5-aea5-fb426559f747' is free. Now locking as 'shared' (1 active user) >Thread-43::DEBUG::2014-09-04 21:04:50,365::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.78390355-2a2d-41e5-aea5-fb426559f747`ReqID=`c1a3fa2e-d76e-4086-8f87-cd40c0c843d7`::Granted request >Thread-43::DEBUG::2014-09-04 21:04:50,365::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`f0b2e047-df11-4134-acf2-9f3db92123e9`::_resourcesAcquired: Storage.78390355-2a2d-41e5-aea5-fb426559f747 (shared) >Thread-43::DEBUG::2014-09-04 21:04:50,365::task::993::Storage.TaskManager.Task::(_decref) Task=`f0b2e047-df11-4134-acf2-9f3db92123e9`::ref 1 aborting False >Thread-14::DEBUG::2014-09-04 21:04:50,375::__init__::225::IOProcess::(_processLogs) Message size is 166 >Thread-14::DEBUG::2014-09-04 21:04:50,375::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:04:50,375::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-04 21:04:50,375::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:04:50,375::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:04:50,376::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:04:50,376::__init__::225::IOProcess::(_processLogs) (844198) Finding callback 'statvfs'... >Thread-14::DEBUG::2014-09-04 21:04:50,376::__init__::225::IOProcess::(_processLogs) (844198) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-04 21:04:50,380::__init__::225::IOProcess::(_processLogs) DEBUG|(844198) Building response >Thread-14::DEBUG::2014-09-04 21:04:50,381::__init__::225::IOProcess::(_processLogs) (844198) Queuing response >Thread-43::INFO::2014-09-04 21:04:50,381::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': u'/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_qa_shared__iso__domain/7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 8L, 'domains': '180c43ee-5baf-41b7-87c7-c0214b51fe8f:Active,7ad04229-b793-4f73-ad10-5e41a4e836ff:Active,7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6:Active', 'master_uuid': u'180c43ee-5baf-41b7-87c7-c0214b51fe8f', 'version': '3', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'180c43ee-5baf-41b7-87c7-c0214b51fe8f': {'status': 'Active', 'diskfree': '1820606201856', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246104576', 'version': 3}, '7ad04229-b793-4f73-ad10-5e41a4e836ff': {'status': 'Active', 'diskfree': '1820606201856', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246104576', 'version': 0}, '7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6': {'status': 'Active', 'diskfree': '18882756608', 'isoprefix': u'/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_qa_shared__iso__domain/7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '652611682304', 'version': 0}}} >Thread-14::DEBUG::2014-09-04 21:04:50,382::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-43::DEBUG::2014-09-04 21:04:50,383::task::1191::Storage.TaskManager.Task::(prepare) Task=`f0b2e047-df11-4134-acf2-9f3db92123e9`::finished: {'info': {'name': 'No Description', 'isoprefix': u'/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_qa_shared__iso__domain/7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 8L, 'domains': '180c43ee-5baf-41b7-87c7-c0214b51fe8f:Active,7ad04229-b793-4f73-ad10-5e41a4e836ff:Active,7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6:Active', 'master_uuid': u'180c43ee-5baf-41b7-87c7-c0214b51fe8f', 'version': '3', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'180c43ee-5baf-41b7-87c7-c0214b51fe8f': {'status': 'Active', 'diskfree': '1820606201856', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246104576', 'version': 3}, '7ad04229-b793-4f73-ad10-5e41a4e836ff': {'status': 'Active', 'diskfree': '1820606201856', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246104576', 'version': 0}, '7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6': {'status': 'Active', 'diskfree': '18882756608', 'isoprefix': u'/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_qa_shared__iso__domain/7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '652611682304', 'version': 0}}} >Thread-14::DEBUG::2014-09-04 21:04:50,383::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-43::DEBUG::2014-09-04 21:04:50,384::task::595::Storage.TaskManager.Task::(_updateState) Task=`f0b2e047-df11-4134-acf2-9f3db92123e9`::moving from state preparing -> state finished >Thread-43::DEBUG::2014-09-04 21:04:50,385::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.78390355-2a2d-41e5-aea5-fb426559f747': < ResourceRef 'Storage.78390355-2a2d-41e5-aea5-fb426559f747', isValid: 'True' obj: 'None'>} >Thread-43::DEBUG::2014-09-04 21:04:50,386::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-43::DEBUG::2014-09-04 21:04:50,388::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.78390355-2a2d-41e5-aea5-fb426559f747' >Thread-17::DEBUG::2014-09-04 21:04:50,389::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_artyom__storage__rhevm__35/180c43ee-5baf-41b7-87c7-c0214b51fe8f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-43::DEBUG::2014-09-04 21:04:50,390::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.78390355-2a2d-41e5-aea5-fb426559f747' (0 active users) >Thread-43::DEBUG::2014-09-04 21:04:50,721::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.78390355-2a2d-41e5-aea5-fb426559f747' is free, finding out if anyone is waiting for it. >Thread-43::DEBUG::2014-09-04 21:04:50,726::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.78390355-2a2d-41e5-aea5-fb426559f747', Clearing records. >Thread-17::DEBUG::2014-09-04 21:04:50,898::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n474 bytes (474 B) copied, 0.000304517 s, 1.6 MB/s\n'; <rc> = 0 >Thread-43::DEBUG::2014-09-04 21:04:50,904::task::993::Storage.TaskManager.Task::(_decref) Task=`f0b2e047-df11-4134-acf2-9f3db92123e9`::ref 0 aborting False >Thread-14::DEBUG::2014-09-04 21:04:50,908::__init__::225::IOProcess::(_processLogs) Message size is 166 >Thread-14::DEBUG::2014-09-04 21:04:50,911::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:04:50,914::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-04 21:04:50,916::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:04:50,919::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:04:50,921::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:04:50,923::__init__::225::IOProcess::(_processLogs) (844199) Finding callback 'statvfs'... >Thread-14::DEBUG::2014-09-04 21:04:50,926::__init__::225::IOProcess::(_processLogs) (844199) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-04 21:04:50,927::__init__::225::IOProcess::(_processLogs) (844199) Queuing response >Thread-14::DEBUG::2014-09-04 21:04:50,929::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:04:50,930::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-14::DEBUG::2014-09-04 21:04:50,937::__init__::225::IOProcess::(_processLogs) Message size is 183 >Thread-14::DEBUG::2014-09-04 21:04:50,939::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:04:50,940::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-04 21:04:50,941::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:04:50,943::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:04:50,944::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:04:50,945::__init__::225::IOProcess::(_processLogs) (844200) Finding callback 'access'... >Thread-14::DEBUG::2014-09-04 21:04:50,946::__init__::225::IOProcess::(_processLogs) (844200) Got request for method 'access' >Thread-14::DEBUG::2014-09-04 21:04:50,947::__init__::225::IOProcess::(_processLogs) (844200) Building response >Thread-14::DEBUG::2014-09-04 21:04:50,948::__init__::225::IOProcess::(_processLogs) (844200) Queuing response >Thread-14::DEBUG::2014-09-04 21:04:50,949::__init__::225::IOProcess::(_processLogs) Generating json... >GuestMonitor-quota__vm::DEBUG::2014-09-04 21:04:50,955::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >GuestMonitor-numa__test::DEBUG::2014-09-04 21:04:50,965::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >Thread-14::DEBUG::2014-09-04 21:04:50,962::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >GuestMonitor-quota__vm::DEBUG::2014-09-04 21:04:50,972::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >GuestMonitor-numa__test::DEBUG::2014-09-04 21:04:50,981::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >Thread-14::DEBUG::2014-09-04 21:04:50,988::__init__::225::IOProcess::(_processLogs) Message size is 187 >GuestMonitor-quota__vm::DEBUG::2014-09-04 21:04:50,991::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >Thread-14::DEBUG::2014-09-04 21:04:50,993::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:04:50,998::__init__::225::IOProcess::(_processLogs) Queuing request... >GuestMonitor-numa__test::DEBUG::2014-09-04 21:04:51,000::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >Thread-14::DEBUG::2014-09-04 21:04:51,002::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:04:51,005::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:04:51,008::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:04:51,009::__init__::225::IOProcess::(_processLogs) (844201) Finding callback 'access'... >Thread-14::DEBUG::2014-09-04 21:04:51,010::__init__::225::IOProcess::(_processLogs) (844201) Got request for method 'access' >Thread-14::DEBUG::2014-09-04 21:04:51,011::__init__::225::IOProcess::(_processLogs) (844201) Queuing response >Thread-14::DEBUG::2014-09-04 21:04:51,012::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:04:51,013::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-14::DEBUG::2014-09-04 21:04:51,017::__init__::225::IOProcess::(_processLogs) Message size is 189 >Thread-14::DEBUG::2014-09-04 21:04:51,019::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:04:51,020::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-04 21:04:51,021::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:04:51,023::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:04:51,024::__init__::225::IOProcess::(_processLogs) (844202) Finding callback 'access'... >Thread-14::DEBUG::2014-09-04 21:04:51,025::__init__::225::IOProcess::(_processLogs) (844202) Got request for method 'access' >Thread-14::DEBUG::2014-09-04 21:04:51,026::__init__::225::IOProcess::(_processLogs) (844202) Building response >Thread-14::DEBUG::2014-09-04 21:04:51,026::__init__::225::IOProcess::(_processLogs) (844202) Queuing response >Thread-14::DEBUG::2014-09-04 21:04:51,027::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:04:51,028::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-41::DEBUG::2014-09-04 21:04:52,347::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/78390355-2a2d-41e5-aea5-fb426559f747/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-41::DEBUG::2014-09-04 21:04:52,710::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0125696 s, 81.5 MB/s\n'; <rc> = 0 >Dummy-41::DEBUG::2014-09-04 21:04:54,722::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/78390355-2a2d-41e5-aea5-fb426559f747/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-41::DEBUG::2014-09-04 21:04:55,105::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0125319 s, 81.7 MB/s\n'; <rc> = 0 >GuestMonitor-quota__vm::DEBUG::2014-09-04 21:04:56,008::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >GuestMonitor-quota__vm::DEBUG::2014-09-04 21:04:56,012::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >GuestMonitor-numa__test::DEBUG::2014-09-04 21:04:56,017::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >GuestMonitor-quota__vm::DEBUG::2014-09-04 21:04:56,024::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >GuestMonitor-numa__test::DEBUG::2014-09-04 21:04:56,025::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >GuestMonitor-numa__test::DEBUG::2014-09-04 21:04:56,032::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >Dummy-41::DEBUG::2014-09-04 21:04:57,138::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/78390355-2a2d-41e5-aea5-fb426559f747/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-41::DEBUG::2014-09-04 21:04:57,511::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0123537 s, 82.9 MB/s\n'; <rc> = 0 >Thread-14054::DEBUG::2014-09-04 21:04:58,695::task::595::Storage.TaskManager.Task::(_updateState) Task=`75a68f06-bfe4-4322-91cf-6225dadeb94b`::moving from state init -> state preparing >Thread-14054::INFO::2014-09-04 21:04:58,695::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14054::INFO::2014-09-04 21:04:58,695::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180c43ee-5baf-41b7-87c7-c0214b51fe8f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000304517', 'lastCheck': '7.7', 'valid': True}, '7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00047906', 'lastCheck': '8.4', 'valid': True}, '7ad04229-b793-4f73-ad10-5e41a4e836ff': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000314504', 'lastCheck': '8.4', 'valid': True}} >Thread-14054::DEBUG::2014-09-04 21:04:58,695::task::1191::Storage.TaskManager.Task::(prepare) Task=`75a68f06-bfe4-4322-91cf-6225dadeb94b`::finished: {'180c43ee-5baf-41b7-87c7-c0214b51fe8f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000304517', 'lastCheck': '7.7', 'valid': True}, '7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00047906', 'lastCheck': '8.4', 'valid': True}, '7ad04229-b793-4f73-ad10-5e41a4e836ff': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000314504', 'lastCheck': '8.4', 'valid': True}} >Thread-14054::DEBUG::2014-09-04 21:04:58,696::task::595::Storage.TaskManager.Task::(_updateState) Task=`75a68f06-bfe4-4322-91cf-6225dadeb94b`::moving from state preparing -> state finished >Thread-14054::DEBUG::2014-09-04 21:04:58,696::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14054::DEBUG::2014-09-04 21:04:58,696::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14054::DEBUG::2014-09-04 21:04:58,696::task::993::Storage.TaskManager.Task::(_decref) Task=`75a68f06-bfe4-4322-91cf-6225dadeb94b`::ref 0 aborting False >Thread-14054::DEBUG::2014-09-04 21:04:58,718::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >Thread-14054::DEBUG::2014-09-04 21:04:58,719::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >Dummy-41::DEBUG::2014-09-04 21:04:59,524::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/78390355-2a2d-41e5-aea5-fb426559f747/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-41::DEBUG::2014-09-04 21:04:59,888::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0123943 s, 82.6 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-04 21:05:00,276::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-14::DEBUG::2014-09-04 21:05:00,277::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-04 21:05:00,277::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:05:00,277::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:05:00,277::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:05:00,277::__init__::225::IOProcess::(_processLogs) (844203) Finding callback 'statvfs'... >Thread-14::DEBUG::2014-09-04 21:05:00,277::__init__::225::IOProcess::(_processLogs) (844203) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-04 21:05:00,277::__init__::225::IOProcess::(_processLogs) (844203) Queuing response >Thread-14::DEBUG::2014-09-04 21:05:00,277::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:05:00,278::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-10379::DEBUG::2014-09-04 21:05:00,278::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mavital/7ad04229-b793-4f73-ad10-5e41a4e836ff/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-14::DEBUG::2014-09-04 21:05:00,612::__init__::225::IOProcess::(_processLogs) Message size is 190 >Thread-10379::DEBUG::2014-09-04 21:05:00,614::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n339 bytes (339 B) copied, 0.000340797 s, 995 kB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-04 21:05:00,615::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:05:00,617::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-04 21:05:00,619::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:05:00,620::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:05:00,621::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:05:00,622::__init__::225::IOProcess::(_processLogs) (844204) Finding callback 'statvfs'... >Thread-14::DEBUG::2014-09-04 21:05:00,624::__init__::225::IOProcess::(_processLogs) (844204) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-04 21:05:00,625::__init__::225::IOProcess::(_processLogs) (844204) Queuing response >Thread-14::DEBUG::2014-09-04 21:05:00,626::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:05:00,628::__init__::225::IOProcess::(_processLogs) Sending response sized 329 >Thread-14::DEBUG::2014-09-04 21:05:00,634::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-09-04 21:05:00,637::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_qa_shared__iso__domain/7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-14::DEBUG::2014-09-04 21:05:00,638::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:05:00,957::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-04 21:05:00,962::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14054::DEBUG::2014-09-04 21:05:00,963::BindingXMLRPC::318::vds::(wrapper) client [10.35.163.104] flowID [2f4972ac] >Thread-18::DEBUG::2014-09-04 21:05:00,964::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1618 bytes (1.6 kB) copied, 0.000413576 s, 3.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-04 21:05:00,967::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14054::DEBUG::2014-09-04 21:05:00,972::task::595::Storage.TaskManager.Task::(_updateState) Task=`f4f35396-87dc-4abd-b780-4595fe362ca0`::moving from state init -> state preparing >Thread-14054::INFO::2014-09-04 21:05:00,973::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='78390355-2a2d-41e5-aea5-fb426559f747', options=None) >Thread-14::DEBUG::2014-09-04 21:05:00,973::__init__::225::IOProcess::(_processLogs) (844205) Finding callback 'statvfs'... >Thread-14::DEBUG::2014-09-04 21:05:00,975::__init__::225::IOProcess::(_processLogs) (844205) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-04 21:05:00,977::__init__::225::IOProcess::(_processLogs) (844205) Building response >Thread-14::DEBUG::2014-09-04 21:05:00,977::__init__::225::IOProcess::(_processLogs) (844205) Queuing response >Thread-14::DEBUG::2014-09-04 21:05:00,977::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:05:00,977::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-14::DEBUG::2014-09-04 21:05:00,979::__init__::225::IOProcess::(_processLogs) Message size is 190 >Thread-14::DEBUG::2014-09-04 21:05:00,980::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:05:00,980::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-04 21:05:00,980::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:05:00,980::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:05:00,980::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:05:00,981::__init__::225::IOProcess::(_processLogs) (844206) Finding callback 'statvfs'... >Thread-14::DEBUG::2014-09-04 21:05:00,981::__init__::225::IOProcess::(_processLogs) (844206) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-04 21:05:00,981::__init__::225::IOProcess::(_processLogs) (844206) Queuing response >Thread-14::DEBUG::2014-09-04 21:05:00,981::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:05:00,981::__init__::225::IOProcess::(_processLogs) Sending response sized 329 >Thread-14054::INFO::2014-09-04 21:05:00,987::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 8L}} >Thread-14054::DEBUG::2014-09-04 21:05:00,987::task::1191::Storage.TaskManager.Task::(prepare) Task=`f4f35396-87dc-4abd-b780-4595fe362ca0`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 8L}} >Thread-14054::DEBUG::2014-09-04 21:05:00,987::task::595::Storage.TaskManager.Task::(_updateState) Task=`f4f35396-87dc-4abd-b780-4595fe362ca0`::moving from state preparing -> state finished >Thread-14054::DEBUG::2014-09-04 21:05:00,987::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14054::DEBUG::2014-09-04 21:05:00,987::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14054::DEBUG::2014-09-04 21:05:00,987::task::993::Storage.TaskManager.Task::(_decref) Task=`f4f35396-87dc-4abd-b780-4595fe362ca0`::ref 0 aborting False >Thread-43::DEBUG::2014-09-04 21:05:01,000::BindingXMLRPC::318::vds::(wrapper) client [10.35.163.104] flowID [2f4972ac] >Thread-43::DEBUG::2014-09-04 21:05:01,001::task::595::Storage.TaskManager.Task::(_updateState) Task=`efd175f0-f865-4931-8366-18af284d036d`::moving from state init -> state preparing >Thread-43::INFO::2014-09-04 21:05:01,001::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='78390355-2a2d-41e5-aea5-fb426559f747', options=None) >Thread-43::DEBUG::2014-09-04 21:05:01,001::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.78390355-2a2d-41e5-aea5-fb426559f747`ReqID=`36de98b6-0971-406c-a57e-9aa61f84a0e7`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-43::DEBUG::2014-09-04 21:05:01,001::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.78390355-2a2d-41e5-aea5-fb426559f747' for lock type 'shared' >Thread-43::DEBUG::2014-09-04 21:05:01,002::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.78390355-2a2d-41e5-aea5-fb426559f747' is free. Now locking as 'shared' (1 active user) >Thread-43::DEBUG::2014-09-04 21:05:01,002::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.78390355-2a2d-41e5-aea5-fb426559f747`ReqID=`36de98b6-0971-406c-a57e-9aa61f84a0e7`::Granted request >Thread-43::DEBUG::2014-09-04 21:05:01,002::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`efd175f0-f865-4931-8366-18af284d036d`::_resourcesAcquired: Storage.78390355-2a2d-41e5-aea5-fb426559f747 (shared) >Thread-43::DEBUG::2014-09-04 21:05:01,002::task::993::Storage.TaskManager.Task::(_decref) Task=`efd175f0-f865-4931-8366-18af284d036d`::ref 1 aborting False >Thread-43::INFO::2014-09-04 21:05:01,017::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': u'/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_qa_shared__iso__domain/7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 8L, 'domains': '180c43ee-5baf-41b7-87c7-c0214b51fe8f:Active,7ad04229-b793-4f73-ad10-5e41a4e836ff:Active,7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6:Active', 'master_uuid': u'180c43ee-5baf-41b7-87c7-c0214b51fe8f', 'version': '3', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'180c43ee-5baf-41b7-87c7-c0214b51fe8f': {'status': 'Active', 'diskfree': '1820606201856', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246104576', 'version': 3}, '7ad04229-b793-4f73-ad10-5e41a4e836ff': {'status': 'Active', 'diskfree': '1820606136320', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246104576', 'version': 0}, '7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6': {'status': 'Active', 'diskfree': '18882756608', 'isoprefix': u'/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_qa_shared__iso__domain/7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '652611682304', 'version': 0}}} >Thread-43::DEBUG::2014-09-04 21:05:01,018::task::1191::Storage.TaskManager.Task::(prepare) Task=`efd175f0-f865-4931-8366-18af284d036d`::finished: {'info': {'name': 'No Description', 'isoprefix': u'/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_qa_shared__iso__domain/7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 8L, 'domains': '180c43ee-5baf-41b7-87c7-c0214b51fe8f:Active,7ad04229-b793-4f73-ad10-5e41a4e836ff:Active,7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6:Active', 'master_uuid': u'180c43ee-5baf-41b7-87c7-c0214b51fe8f', 'version': '3', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'180c43ee-5baf-41b7-87c7-c0214b51fe8f': {'status': 'Active', 'diskfree': '1820606201856', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246104576', 'version': 3}, '7ad04229-b793-4f73-ad10-5e41a4e836ff': {'status': 'Active', 'diskfree': '1820606136320', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246104576', 'version': 0}, '7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6': {'status': 'Active', 'diskfree': '18882756608', 'isoprefix': u'/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_qa_shared__iso__domain/7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '652611682304', 'version': 0}}} >Thread-43::DEBUG::2014-09-04 21:05:01,018::task::595::Storage.TaskManager.Task::(_updateState) Task=`efd175f0-f865-4931-8366-18af284d036d`::moving from state preparing -> state finished >Thread-43::DEBUG::2014-09-04 21:05:01,018::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.78390355-2a2d-41e5-aea5-fb426559f747': < ResourceRef 'Storage.78390355-2a2d-41e5-aea5-fb426559f747', isValid: 'True' obj: 'None'>} >Thread-43::DEBUG::2014-09-04 21:05:01,018::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-43::DEBUG::2014-09-04 21:05:01,018::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.78390355-2a2d-41e5-aea5-fb426559f747' >Thread-43::DEBUG::2014-09-04 21:05:01,018::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.78390355-2a2d-41e5-aea5-fb426559f747' (0 active users) >Thread-43::DEBUG::2014-09-04 21:05:01,018::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.78390355-2a2d-41e5-aea5-fb426559f747' is free, finding out if anyone is waiting for it. >Thread-43::DEBUG::2014-09-04 21:05:01,019::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.78390355-2a2d-41e5-aea5-fb426559f747', Clearing records. >Thread-43::DEBUG::2014-09-04 21:05:01,019::task::993::Storage.TaskManager.Task::(_decref) Task=`efd175f0-f865-4931-8366-18af284d036d`::ref 0 aborting False >Thread-14::DEBUG::2014-09-04 21:05:01,033::__init__::225::IOProcess::(_processLogs) Message size is 166 >Thread-14::DEBUG::2014-09-04 21:05:01,033::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:05:01,033::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:05:01,033::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:05:01,033::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:05:01,033::__init__::225::IOProcess::(_processLogs) (844207) Finding callback 'statvfs'... >Thread-14::DEBUG::2014-09-04 21:05:01,034::__init__::225::IOProcess::(_processLogs) (844207) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-04 21:05:01,034::__init__::225::IOProcess::(_processLogs) (844207) Queuing response >Thread-14::DEBUG::2014-09-04 21:05:01,034::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:05:01,034::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-17::DEBUG::2014-09-04 21:05:01,035::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_artyom__storage__rhevm__35/180c43ee-5baf-41b7-87c7-c0214b51fe8f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >GuestMonitor-numa__test::DEBUG::2014-09-04 21:05:01,380::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >Thread-17::DEBUG::2014-09-04 21:05:01,380::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n474 bytes (474 B) copied, 0.000297545 s, 1.6 MB/s\n'; <rc> = 0 >GuestMonitor-quota__vm::DEBUG::2014-09-04 21:05:01,382::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >Thread-14::DEBUG::2014-09-04 21:05:01,391::__init__::225::IOProcess::(_processLogs) Message size is 166 >Thread-14::DEBUG::2014-09-04 21:05:01,396::__init__::225::IOProcess::(_processLogs) Marshaling message... >GuestMonitor-numa__test::DEBUG::2014-09-04 21:05:01,398::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >VM Channels Listener::DEBUG::2014-09-04 21:05:07,725::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 44. >GuestMonitor-quota__vm::DEBUG::2014-09-04 21:05:07,730::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >Thread-14::DEBUG::2014-09-04 21:05:01,400::__init__::225::IOProcess::(_processLogs) Queuing request... >Dummy-41::DEBUG::2014-09-04 21:05:07,736::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/78390355-2a2d-41e5-aea5-fb426559f747/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >VM Channels Listener::DEBUG::2014-09-04 21:05:07,817::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 57. >Thread-14::DEBUG::2014-09-04 21:05:08,156::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:05:08,357::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >GuestMonitor-numa__test::DEBUG::2014-09-04 21:05:08,363::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >Thread-14::DEBUG::2014-09-04 21:05:08,367::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:05:08,376::__init__::225::IOProcess::(_processLogs) (844208) Finding callback 'statvfs'... >GuestMonitor-quota__vm::DEBUG::2014-09-04 21:05:08,376::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >Thread-14::DEBUG::2014-09-04 21:05:08,385::__init__::225::IOProcess::(_processLogs) (844208) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-04 21:05:08,392::__init__::225::IOProcess::(_processLogs) (844208) Queuing response >Thread-14::DEBUG::2014-09-04 21:05:08,398::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:05:08,404::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-14::DEBUG::2014-09-04 21:05:08,430::__init__::225::IOProcess::(_processLogs) Message size is 183 >Thread-14::DEBUG::2014-09-04 21:05:08,434::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:05:08,438::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-04 21:05:08,443::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:05:08,446::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:05:08,451::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:05:08,454::__init__::225::IOProcess::(_processLogs) (844209) Got request for method 'access' >Thread-14::DEBUG::2014-09-04 21:05:08,458::__init__::225::IOProcess::(_processLogs) (844209) Building response >Thread-14::DEBUG::2014-09-04 21:05:08,462::__init__::225::IOProcess::(_processLogs) (844209) Queuing response >Thread-14::DEBUG::2014-09-04 21:05:08,466::__init__::225::IOProcess::(_processLogs) Generating json... >Dummy-41::DEBUG::2014-09-04 21:05:08,683::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.307015 s, 3.3 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-04 21:05:08,692::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-14::DEBUG::2014-09-04 21:05:08,705::__init__::225::IOProcess::(_processLogs) Message size is 187 >Thread-14::DEBUG::2014-09-04 21:05:08,709::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:05:08,712::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-04 21:05:08,716::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:05:08,719::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:05:08,722::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:05:08,726::__init__::225::IOProcess::(_processLogs) (844210) Finding callback 'access'... >Thread-14::DEBUG::2014-09-04 21:05:08,729::__init__::225::IOProcess::(_processLogs) (844210) Got request for method 'access' >Thread-14::DEBUG::2014-09-04 21:05:08,732::__init__::225::IOProcess::(_processLogs) (844210) Building response >Thread-14::DEBUG::2014-09-04 21:05:08,735::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:05:08,739::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-14::DEBUG::2014-09-04 21:05:08,750::__init__::225::IOProcess::(_processLogs) Message size is 189 >Thread-14::DEBUG::2014-09-04 21:05:08,753::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:05:08,757::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-04 21:05:08,760::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:05:08,763::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:05:08,767::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:05:08,770::__init__::225::IOProcess::(_processLogs) (844211) Finding callback 'access'... >Thread-14::DEBUG::2014-09-04 21:05:08,773::__init__::225::IOProcess::(_processLogs) (844211) Got request for method 'access' >Thread-14::DEBUG::2014-09-04 21:05:08,777::__init__::225::IOProcess::(_processLogs) (844211) Queuing response >Thread-14::DEBUG::2014-09-04 21:05:08,780::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:05:08,783::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-41::DEBUG::2014-09-04 21:05:10,921::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/78390355-2a2d-41e5-aea5-fb426559f747/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-14054::DEBUG::2014-09-04 21:05:11,257::BindingXMLRPC::318::vds::(wrapper) client [10.35.163.104] flowID [1c8f862] >Thread-14::DEBUG::2014-09-04 21:05:11,259::__init__::225::IOProcess::(_processLogs) Message size is 190 >Thread-14054::DEBUG::2014-09-04 21:05:11,261::task::595::Storage.TaskManager.Task::(_updateState) Task=`441306d5-9d3f-4789-a3e6-f76bd2d2c9f7`::moving from state init -> state preparing >Thread-14::DEBUG::2014-09-04 21:05:11,262::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14054::INFO::2014-09-04 21:05:11,263::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='78390355-2a2d-41e5-aea5-fb426559f747', options=None) >Thread-14::DEBUG::2014-09-04 21:05:11,265::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:05:11,266::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:05:11,267::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:05:11,268::__init__::225::IOProcess::(_processLogs) (844212) Finding callback 'statvfs'... >Thread-14::DEBUG::2014-09-04 21:05:11,269::__init__::225::IOProcess::(_processLogs) (844212) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-04 21:05:11,269::__init__::225::IOProcess::(_processLogs) (844212) Building response >Thread-14::DEBUG::2014-09-04 21:05:11,270::__init__::225::IOProcess::(_processLogs) (844212) Queuing response >Thread-14::DEBUG::2014-09-04 21:05:11,270::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:05:11,271::__init__::225::IOProcess::(_processLogs) Sending response sized 329 >Thread-14::DEBUG::2014-09-04 21:05:11,274::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-09-04 21:05:11,275::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_qa_shared__iso__domain/7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-14::DEBUG::2014-09-04 21:05:11,275::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14054::INFO::2014-09-04 21:05:11,610::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 8L}} >Thread-14::DEBUG::2014-09-04 21:05:11,610::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14054::DEBUG::2014-09-04 21:05:11,619::task::1191::Storage.TaskManager.Task::(prepare) Task=`441306d5-9d3f-4789-a3e6-f76bd2d2c9f7`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 8L}} >Thread-14::DEBUG::2014-09-04 21:05:11,621::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-09-04 21:05:11,622::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1581 bytes (1.6 kB) copied, 0.000360602 s, 4.4 MB/s\n'; <rc> = 0 >Thread-14054::DEBUG::2014-09-04 21:05:11,625::task::595::Storage.TaskManager.Task::(_updateState) Task=`441306d5-9d3f-4789-a3e6-f76bd2d2c9f7`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-09-04 21:05:11,628::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14054::DEBUG::2014-09-04 21:05:11,630::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-09-04 21:05:11,633::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14054::DEBUG::2014-09-04 21:05:11,633::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-09-04 21:05:11,637::__init__::225::IOProcess::(_processLogs) (844213) Finding callback 'statvfs'... >Thread-14054::DEBUG::2014-09-04 21:05:11,638::task::993::Storage.TaskManager.Task::(_decref) Task=`441306d5-9d3f-4789-a3e6-f76bd2d2c9f7`::ref 0 aborting False >Thread-14::DEBUG::2014-09-04 21:05:11,640::__init__::225::IOProcess::(_processLogs) (844213) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-04 21:05:11,643::__init__::225::IOProcess::(_processLogs) (844213) Queuing response >Thread-14::DEBUG::2014-09-04 21:05:11,646::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:05:11,646::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-14::DEBUG::2014-09-04 21:05:11,652::__init__::225::IOProcess::(_processLogs) Message size is 190 >Thread-10379::DEBUG::2014-09-04 21:05:11,653::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mavital/7ad04229-b793-4f73-ad10-5e41a4e836ff/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-14::DEBUG::2014-09-04 21:05:11,655::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:05:11,994::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-43::DEBUG::2014-09-04 21:05:12,031::BindingXMLRPC::318::vds::(wrapper) client [10.35.163.104] flowID [1c8f862] >Thread-10379::DEBUG::2014-09-04 21:05:12,031::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n339 bytes (339 B) copied, 0.000347285 s, 976 kB/s\n'; <rc> = 0 >Dummy-41::DEBUG::2014-09-04 21:05:12,033::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.403748 s, 2.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-04 21:05:12,033::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-43::DEBUG::2014-09-04 21:05:12,038::task::595::Storage.TaskManager.Task::(_updateState) Task=`339679b1-baf6-4874-af6b-e04db4c2234f`::moving from state init -> state preparing >Thread-43::INFO::2014-09-04 21:05:12,040::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='78390355-2a2d-41e5-aea5-fb426559f747', options=None) >Thread-14::DEBUG::2014-09-04 21:05:12,039::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:05:12,043::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-43::DEBUG::2014-09-04 21:05:12,044::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.78390355-2a2d-41e5-aea5-fb426559f747`ReqID=`f1f60296-64f5-472d-becb-eccecb347b36`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-43::DEBUG::2014-09-04 21:05:12,046::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.78390355-2a2d-41e5-aea5-fb426559f747' for lock type 'shared' >Thread-14::DEBUG::2014-09-04 21:05:12,045::__init__::225::IOProcess::(_processLogs) (844214) Finding callback 'statvfs'... >Thread-43::DEBUG::2014-09-04 21:05:12,048::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.78390355-2a2d-41e5-aea5-fb426559f747' is free. Now locking as 'shared' (1 active user) >Thread-14::DEBUG::2014-09-04 21:05:12,048::__init__::225::IOProcess::(_processLogs) (844214) Got request for method 'statvfs' >Thread-43::DEBUG::2014-09-04 21:05:12,050::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.78390355-2a2d-41e5-aea5-fb426559f747`ReqID=`f1f60296-64f5-472d-becb-eccecb347b36`::Granted request >Thread-14::DEBUG::2014-09-04 21:05:12,052::__init__::225::IOProcess::(_processLogs) (844214) Queuing response >Thread-14::DEBUG::2014-09-04 21:05:12,054::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-43::DEBUG::2014-09-04 21:05:12,055::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`339679b1-baf6-4874-af6b-e04db4c2234f`::_resourcesAcquired: Storage.78390355-2a2d-41e5-aea5-fb426559f747 (shared) >Thread-43::DEBUG::2014-09-04 21:05:12,056::task::993::Storage.TaskManager.Task::(_decref) Task=`339679b1-baf6-4874-af6b-e04db4c2234f`::ref 1 aborting False >Thread-14::DEBUG::2014-09-04 21:05:12,056::__init__::225::IOProcess::(_processLogs) Sending response sized 329 >Thread-14::DEBUG::2014-09-04 21:05:12,070::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-14::DEBUG::2014-09-04 21:05:12,074::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:05:12,077::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-04 21:05:12,079::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:05:12,082::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:05:12,084::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:05:12,087::__init__::225::IOProcess::(_processLogs) (844215) Finding callback 'statvfs'... >Thread-14::DEBUG::2014-09-04 21:05:12,090::__init__::225::IOProcess::(_processLogs) (844215) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-04 21:05:12,093::__init__::225::IOProcess::(_processLogs) (844215) Queuing response >Thread-14::DEBUG::2014-09-04 21:05:12,095::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:05:12,097::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-43::INFO::2014-09-04 21:05:12,111::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': u'/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_qa_shared__iso__domain/7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 8L, 'domains': '180c43ee-5baf-41b7-87c7-c0214b51fe8f:Active,7ad04229-b793-4f73-ad10-5e41a4e836ff:Active,7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6:Active', 'master_uuid': u'180c43ee-5baf-41b7-87c7-c0214b51fe8f', 'version': '3', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'180c43ee-5baf-41b7-87c7-c0214b51fe8f': {'status': 'Active', 'diskfree': '1820606136320', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246104576', 'version': 3}, '7ad04229-b793-4f73-ad10-5e41a4e836ff': {'status': 'Active', 'diskfree': '1820607315968', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246104576', 'version': 0}, '7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6': {'status': 'Active', 'diskfree': '18882756608', 'isoprefix': u'/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_qa_shared__iso__domain/7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '652611682304', 'version': 0}}} >Thread-43::DEBUG::2014-09-04 21:05:12,112::task::1191::Storage.TaskManager.Task::(prepare) Task=`339679b1-baf6-4874-af6b-e04db4c2234f`::finished: {'info': {'name': 'No Description', 'isoprefix': u'/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_qa_shared__iso__domain/7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 8L, 'domains': '180c43ee-5baf-41b7-87c7-c0214b51fe8f:Active,7ad04229-b793-4f73-ad10-5e41a4e836ff:Active,7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6:Active', 'master_uuid': u'180c43ee-5baf-41b7-87c7-c0214b51fe8f', 'version': '3', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'180c43ee-5baf-41b7-87c7-c0214b51fe8f': {'status': 'Active', 'diskfree': '1820606136320', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246104576', 'version': 3}, '7ad04229-b793-4f73-ad10-5e41a4e836ff': {'status': 'Active', 'diskfree': '1820607315968', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246104576', 'version': 0}, '7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6': {'status': 'Active', 'diskfree': '18882756608', 'isoprefix': u'/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_qa_shared__iso__domain/7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '652611682304', 'version': 0}}} >Thread-43::DEBUG::2014-09-04 21:05:12,113::task::595::Storage.TaskManager.Task::(_updateState) Task=`339679b1-baf6-4874-af6b-e04db4c2234f`::moving from state preparing -> state finished >Thread-43::DEBUG::2014-09-04 21:05:12,114::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.78390355-2a2d-41e5-aea5-fb426559f747': < ResourceRef 'Storage.78390355-2a2d-41e5-aea5-fb426559f747', isValid: 'True' obj: 'None'>} >Thread-43::DEBUG::2014-09-04 21:05:12,114::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-43::DEBUG::2014-09-04 21:05:12,116::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.78390355-2a2d-41e5-aea5-fb426559f747' >Thread-43::DEBUG::2014-09-04 21:05:12,117::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.78390355-2a2d-41e5-aea5-fb426559f747' (0 active users) >Thread-43::DEBUG::2014-09-04 21:05:12,118::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.78390355-2a2d-41e5-aea5-fb426559f747' is free, finding out if anyone is waiting for it. >Thread-43::DEBUG::2014-09-04 21:05:12,118::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.78390355-2a2d-41e5-aea5-fb426559f747', Clearing records. >Thread-43::DEBUG::2014-09-04 21:05:12,119::task::993::Storage.TaskManager.Task::(_decref) Task=`339679b1-baf6-4874-af6b-e04db4c2234f`::ref 0 aborting False >GuestMonitor-numa__test::DEBUG::2014-09-04 21:05:13,396::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >GuestMonitor-numa__test::DEBUG::2014-09-04 21:05:13,396::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >GuestMonitor-numa__test::DEBUG::2014-09-04 21:05:13,397::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >GuestMonitor-quota__vm::DEBUG::2014-09-04 21:05:13,405::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >GuestMonitor-quota__vm::DEBUG::2014-09-04 21:05:13,406::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >GuestMonitor-quota__vm::DEBUG::2014-09-04 21:05:13,406::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >Dummy-41::DEBUG::2014-09-04 21:05:14,132::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/78390355-2a2d-41e5-aea5-fb426559f747/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-41::DEBUG::2014-09-04 21:05:14,811::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.232701 s, 4.4 MB/s\n'; <rc> = 0 >Dummy-41::DEBUG::2014-09-04 21:05:16,827::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/78390355-2a2d-41e5-aea5-fb426559f747/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-41::DEBUG::2014-09-04 21:05:17,203::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0124856 s, 82.0 MB/s\n'; <rc> = 0 >GuestMonitor-numa__test::DEBUG::2014-09-04 21:05:18,404::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >GuestMonitor-numa__test::DEBUG::2014-09-04 21:05:18,404::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >GuestMonitor-numa__test::DEBUG::2014-09-04 21:05:18,405::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >GuestMonitor-quota__vm::DEBUG::2014-09-04 21:05:18,412::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >GuestMonitor-quota__vm::DEBUG::2014-09-04 21:05:18,413::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >GuestMonitor-quota__vm::DEBUG::2014-09-04 21:05:18,413::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >Thread-14::DEBUG::2014-09-04 21:05:18,793::__init__::225::IOProcess::(_processLogs) Message size is 166 >Thread-14::DEBUG::2014-09-04 21:05:18,793::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:05:18,793::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:05:18,794::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:05:18,794::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:05:18,794::__init__::225::IOProcess::(_processLogs) (844216) Finding callback 'statvfs'... >Thread-14::DEBUG::2014-09-04 21:05:18,794::__init__::225::IOProcess::(_processLogs) (844216) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-04 21:05:18,794::__init__::225::IOProcess::(_processLogs) (844216) Queuing response >Thread-14::DEBUG::2014-09-04 21:05:18,794::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:05:18,794::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-17::DEBUG::2014-09-04 21:05:18,795::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_artyom__storage__rhevm__35/180c43ee-5baf-41b7-87c7-c0214b51fe8f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-09-04 21:05:19,124::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n474 bytes (474 B) copied, 0.00033465 s, 1.4 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-04 21:05:19,128::__init__::225::IOProcess::(_processLogs) Message size is 166 >Thread-14::DEBUG::2014-09-04 21:05:19,129::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:05:19,130::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-04 21:05:19,131::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:05:19,132::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:05:19,134::__init__::225::IOProcess::(_processLogs) (844217) Finding callback 'statvfs'... >Thread-14::DEBUG::2014-09-04 21:05:19,135::__init__::225::IOProcess::(_processLogs) (844217) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-04 21:05:19,136::__init__::225::IOProcess::(_processLogs) (844217) Building response >Thread-14::DEBUG::2014-09-04 21:05:19,137::__init__::225::IOProcess::(_processLogs) (844217) Queuing response >Thread-14::DEBUG::2014-09-04 21:05:19,138::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:05:19,139::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-14::DEBUG::2014-09-04 21:05:19,146::__init__::225::IOProcess::(_processLogs) Message size is 183 >Thread-14::DEBUG::2014-09-04 21:05:19,147::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:05:19,148::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-04 21:05:19,149::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:05:19,150::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:05:19,151::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:05:19,152::__init__::225::IOProcess::(_processLogs) (844218) Finding callback 'access'... >Thread-14::DEBUG::2014-09-04 21:05:19,153::__init__::225::IOProcess::(_processLogs) (844218) Building response >Thread-14::DEBUG::2014-09-04 21:05:19,154::__init__::225::IOProcess::(_processLogs) (844218) Queuing response >Thread-14::DEBUG::2014-09-04 21:05:19,155::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:05:19,156::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-14::DEBUG::2014-09-04 21:05:19,160::__init__::225::IOProcess::(_processLogs) Message size is 187 >Thread-14::DEBUG::2014-09-04 21:05:19,161::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:05:19,161::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-04 21:05:19,163::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:05:19,164::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:05:19,165::__init__::225::IOProcess::(_processLogs) (844219) Finding callback 'access'... >Thread-14::DEBUG::2014-09-04 21:05:19,166::__init__::225::IOProcess::(_processLogs) (844219) Got request for method 'access' >Thread-14::DEBUG::2014-09-04 21:05:19,167::__init__::225::IOProcess::(_processLogs) (844219) Building response >Thread-14::DEBUG::2014-09-04 21:05:19,170::__init__::225::IOProcess::(_processLogs) (844219) Queuing response >Thread-14::DEBUG::2014-09-04 21:05:19,171::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:05:19,172::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-14::DEBUG::2014-09-04 21:05:19,176::__init__::225::IOProcess::(_processLogs) Message size is 189 >Thread-14::DEBUG::2014-09-04 21:05:19,177::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:05:19,178::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-04 21:05:19,179::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:05:19,180::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:05:19,181::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:05:19,183::__init__::225::IOProcess::(_processLogs) (844220) Got request for method 'access' >Thread-14::DEBUG::2014-09-04 21:05:19,184::__init__::225::IOProcess::(_processLogs) (844220) Building response >Thread-14::DEBUG::2014-09-04 21:05:19,185::__init__::225::IOProcess::(_processLogs) (844220) Queuing response >Thread-14::DEBUG::2014-09-04 21:05:19,186::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:05:19,187::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-41::DEBUG::2014-09-04 21:05:19,215::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/78390355-2a2d-41e5-aea5-fb426559f747/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-41::DEBUG::2014-09-04 21:05:19,578::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0128449 s, 79.7 MB/s\n'; <rc> = 0 >Thread-14054::DEBUG::2014-09-04 21:05:20,702::task::595::Storage.TaskManager.Task::(_updateState) Task=`4e8e0301-3e42-4b15-ac3d-8cb6a82f48d3`::moving from state init -> state preparing >Thread-14054::INFO::2014-09-04 21:05:20,702::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14054::INFO::2014-09-04 21:05:20,702::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180c43ee-5baf-41b7-87c7-c0214b51fe8f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00033465', 'lastCheck': '1.5', 'valid': True}, '7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000360602', 'lastCheck': '8.6', 'valid': True}, '7ad04229-b793-4f73-ad10-5e41a4e836ff': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000347285', 'lastCheck': '8.6', 'valid': True}} >Thread-14054::DEBUG::2014-09-04 21:05:20,703::task::1191::Storage.TaskManager.Task::(prepare) Task=`4e8e0301-3e42-4b15-ac3d-8cb6a82f48d3`::finished: {'180c43ee-5baf-41b7-87c7-c0214b51fe8f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00033465', 'lastCheck': '1.5', 'valid': True}, '7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000360602', 'lastCheck': '8.6', 'valid': True}, '7ad04229-b793-4f73-ad10-5e41a4e836ff': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000347285', 'lastCheck': '8.6', 'valid': True}} >Thread-14054::DEBUG::2014-09-04 21:05:20,703::task::595::Storage.TaskManager.Task::(_updateState) Task=`4e8e0301-3e42-4b15-ac3d-8cb6a82f48d3`::moving from state preparing -> state finished >Thread-14054::DEBUG::2014-09-04 21:05:20,703::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14054::DEBUG::2014-09-04 21:05:20,703::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14054::DEBUG::2014-09-04 21:05:20,703::task::993::Storage.TaskManager.Task::(_decref) Task=`4e8e0301-3e42-4b15-ac3d-8cb6a82f48d3`::ref 0 aborting False >Thread-14054::DEBUG::2014-09-04 21:05:20,726::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >Thread-14054::DEBUG::2014-09-04 21:05:20,726::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >Dummy-41::DEBUG::2014-09-04 21:05:21,590::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/78390355-2a2d-41e5-aea5-fb426559f747/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-41::DEBUG::2014-09-04 21:05:21,952::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0129628 s, 79.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-04 21:05:22,084::__init__::225::IOProcess::(_processLogs) Message size is 190 >Thread-14::DEBUG::2014-09-04 21:05:22,084::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:05:22,084::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:05:22,084::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:05:22,085::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:05:22,085::__init__::225::IOProcess::(_processLogs) (844221) Finding callback 'statvfs'... >Thread-14::DEBUG::2014-09-04 21:05:22,085::__init__::225::IOProcess::(_processLogs) (844221) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-04 21:05:22,085::__init__::225::IOProcess::(_processLogs) (844221) Queuing response >Thread-14::DEBUG::2014-09-04 21:05:22,085::__init__::225::IOProcess::(_processLogs) Sending response sized 329 >Thread-18::DEBUG::2014-09-04 21:05:22,086::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_qa_shared__iso__domain/7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-18::DEBUG::2014-09-04 21:05:22,405::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1581 bytes (1.6 kB) copied, 0.000920369 s, 1.7 MB/s\n'; <rc> = 0 >Thread-14054::DEBUG::2014-09-04 21:05:22,405::BindingXMLRPC::318::vds::(wrapper) client [10.35.163.104] >Thread-14::DEBUG::2014-09-04 21:05:22,406::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-14::DEBUG::2014-09-04 21:05:22,409::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14054::DEBUG::2014-09-04 21:05:22,409::task::595::Storage.TaskManager.Task::(_updateState) Task=`e1cbb3ff-e238-4b27-9bd1-a569021081c4`::moving from state init -> state preparing >Thread-14::DEBUG::2014-09-04 21:05:22,410::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14054::INFO::2014-09-04 21:05:22,411::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='78390355-2a2d-41e5-aea5-fb426559f747', options=None) >Thread-14::DEBUG::2014-09-04 21:05:22,411::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:05:22,412::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:05:22,412::__init__::225::IOProcess::(_processLogs) (844222) Finding callback 'statvfs'... >Thread-14::DEBUG::2014-09-04 21:05:22,412::__init__::225::IOProcess::(_processLogs) (844222) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-04 21:05:22,412::__init__::225::IOProcess::(_processLogs) (844222) Building response >Thread-14::DEBUG::2014-09-04 21:05:22,413::__init__::225::IOProcess::(_processLogs) (844222) Queuing response >Thread-14::DEBUG::2014-09-04 21:05:22,413::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:05:22,413::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-10379::DEBUG::2014-09-04 21:05:22,414::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mavital/7ad04229-b793-4f73-ad10-5e41a4e836ff/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-14::DEBUG::2014-09-04 21:05:22,415::__init__::225::IOProcess::(_processLogs) Message size is 190 >Thread-14054::INFO::2014-09-04 21:05:22,747::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 8L}} >Thread-14::DEBUG::2014-09-04 21:05:22,753::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14054::DEBUG::2014-09-04 21:05:22,758::task::1191::Storage.TaskManager.Task::(prepare) Task=`e1cbb3ff-e238-4b27-9bd1-a569021081c4`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 8L}} >Thread-10379::DEBUG::2014-09-04 21:05:22,760::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n339 bytes (339 B) copied, 0.000338414 s, 1.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-04 21:05:22,759::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14054::DEBUG::2014-09-04 21:05:22,762::task::595::Storage.TaskManager.Task::(_updateState) Task=`e1cbb3ff-e238-4b27-9bd1-a569021081c4`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-09-04 21:05:22,766::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14054::DEBUG::2014-09-04 21:05:22,766::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-09-04 21:05:22,769::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14054::DEBUG::2014-09-04 21:05:22,769::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-09-04 21:05:22,773::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14054::DEBUG::2014-09-04 21:05:22,774::task::993::Storage.TaskManager.Task::(_decref) Task=`e1cbb3ff-e238-4b27-9bd1-a569021081c4`::ref 0 aborting False >Thread-14::DEBUG::2014-09-04 21:05:22,777::__init__::225::IOProcess::(_processLogs) (844223) Finding callback 'statvfs'... >Thread-14::DEBUG::2014-09-04 21:05:22,780::__init__::225::IOProcess::(_processLogs) (844223) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-04 21:05:22,783::__init__::225::IOProcess::(_processLogs) (844223) Building response >Thread-14::DEBUG::2014-09-04 21:05:22,785::__init__::225::IOProcess::(_processLogs) (844223) Queuing response >Thread-14::DEBUG::2014-09-04 21:05:22,786::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:05:22,787::__init__::225::IOProcess::(_processLogs) Sending response sized 329 >Thread-14::DEBUG::2014-09-04 21:05:22,795::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-14::DEBUG::2014-09-04 21:05:22,801::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-43::DEBUG::2014-09-04 21:05:22,803::BindingXMLRPC::318::vds::(wrapper) client [10.35.163.104] >Thread-14::DEBUG::2014-09-04 21:05:22,805::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-04 21:05:22,809::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-43::DEBUG::2014-09-04 21:05:22,809::task::595::Storage.TaskManager.Task::(_updateState) Task=`00bed8c0-de29-4066-906a-d279998a4c8f`::moving from state init -> state preparing >Thread-14::DEBUG::2014-09-04 21:05:22,810::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-43::INFO::2014-09-04 21:05:22,811::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='78390355-2a2d-41e5-aea5-fb426559f747', options=None) >Thread-14::DEBUG::2014-09-04 21:05:22,812::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:05:22,814::__init__::225::IOProcess::(_processLogs) (844224) Finding callback 'statvfs'... >Thread-14::DEBUG::2014-09-04 21:05:22,817::__init__::225::IOProcess::(_processLogs) (844224) Got request for method 'statvfs' >Thread-43::DEBUG::2014-09-04 21:05:22,817::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.78390355-2a2d-41e5-aea5-fb426559f747`ReqID=`e1f711b2-f829-4c42-bf93-f06bb108f710`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-43::DEBUG::2014-09-04 21:05:22,818::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.78390355-2a2d-41e5-aea5-fb426559f747' for lock type 'shared' >Thread-14::DEBUG::2014-09-04 21:05:22,818::__init__::225::IOProcess::(_processLogs) (844224) Queuing response >Thread-14::DEBUG::2014-09-04 21:05:22,821::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-43::DEBUG::2014-09-04 21:05:22,821::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.78390355-2a2d-41e5-aea5-fb426559f747' is free. Now locking as 'shared' (1 active user) >Thread-14::DEBUG::2014-09-04 21:05:22,822::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-43::DEBUG::2014-09-04 21:05:22,822::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.78390355-2a2d-41e5-aea5-fb426559f747`ReqID=`e1f711b2-f829-4c42-bf93-f06bb108f710`::Granted request >Thread-43::DEBUG::2014-09-04 21:05:22,825::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`00bed8c0-de29-4066-906a-d279998a4c8f`::_resourcesAcquired: Storage.78390355-2a2d-41e5-aea5-fb426559f747 (shared) >Thread-43::DEBUG::2014-09-04 21:05:22,826::task::993::Storage.TaskManager.Task::(_decref) Task=`00bed8c0-de29-4066-906a-d279998a4c8f`::ref 1 aborting False >Thread-43::INFO::2014-09-04 21:05:22,842::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': u'/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_qa_shared__iso__domain/7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 8L, 'domains': '180c43ee-5baf-41b7-87c7-c0214b51fe8f:Active,7ad04229-b793-4f73-ad10-5e41a4e836ff:Active,7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6:Active', 'master_uuid': u'180c43ee-5baf-41b7-87c7-c0214b51fe8f', 'version': '3', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'180c43ee-5baf-41b7-87c7-c0214b51fe8f': {'status': 'Active', 'diskfree': '1820607381504', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246104576', 'version': 3}, '7ad04229-b793-4f73-ad10-5e41a4e836ff': {'status': 'Active', 'diskfree': '1820607381504', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246104576', 'version': 0}, '7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6': {'status': 'Active', 'diskfree': '18882756608', 'isoprefix': u'/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_qa_shared__iso__domain/7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '652611682304', 'version': 0}}} >Thread-43::DEBUG::2014-09-04 21:05:22,843::task::1191::Storage.TaskManager.Task::(prepare) Task=`00bed8c0-de29-4066-906a-d279998a4c8f`::finished: {'info': {'name': 'No Description', 'isoprefix': u'/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_qa_shared__iso__domain/7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 8L, 'domains': '180c43ee-5baf-41b7-87c7-c0214b51fe8f:Active,7ad04229-b793-4f73-ad10-5e41a4e836ff:Active,7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6:Active', 'master_uuid': u'180c43ee-5baf-41b7-87c7-c0214b51fe8f', 'version': '3', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'180c43ee-5baf-41b7-87c7-c0214b51fe8f': {'status': 'Active', 'diskfree': '1820607381504', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246104576', 'version': 3}, '7ad04229-b793-4f73-ad10-5e41a4e836ff': {'status': 'Active', 'diskfree': '1820607381504', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246104576', 'version': 0}, '7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6': {'status': 'Active', 'diskfree': '18882756608', 'isoprefix': u'/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_qa_shared__iso__domain/7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '652611682304', 'version': 0}}} >Thread-43::DEBUG::2014-09-04 21:05:22,843::task::595::Storage.TaskManager.Task::(_updateState) Task=`00bed8c0-de29-4066-906a-d279998a4c8f`::moving from state preparing -> state finished >Thread-43::DEBUG::2014-09-04 21:05:22,843::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.78390355-2a2d-41e5-aea5-fb426559f747': < ResourceRef 'Storage.78390355-2a2d-41e5-aea5-fb426559f747', isValid: 'True' obj: 'None'>} >Thread-43::DEBUG::2014-09-04 21:05:22,843::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-43::DEBUG::2014-09-04 21:05:22,843::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.78390355-2a2d-41e5-aea5-fb426559f747' >Thread-43::DEBUG::2014-09-04 21:05:22,843::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.78390355-2a2d-41e5-aea5-fb426559f747' (0 active users) >Thread-43::DEBUG::2014-09-04 21:05:22,844::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.78390355-2a2d-41e5-aea5-fb426559f747' is free, finding out if anyone is waiting for it. >Thread-43::DEBUG::2014-09-04 21:05:22,844::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.78390355-2a2d-41e5-aea5-fb426559f747', Clearing records. >Thread-43::DEBUG::2014-09-04 21:05:22,844::task::993::Storage.TaskManager.Task::(_decref) Task=`00bed8c0-de29-4066-906a-d279998a4c8f`::ref 0 aborting False >GuestMonitor-numa__test::DEBUG::2014-09-04 21:05:23,411::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >GuestMonitor-numa__test::DEBUG::2014-09-04 21:05:23,412::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >GuestMonitor-numa__test::DEBUG::2014-09-04 21:05:23,413::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >GuestMonitor-quota__vm::DEBUG::2014-09-04 21:05:23,419::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >GuestMonitor-quota__vm::DEBUG::2014-09-04 21:05:23,420::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >GuestMonitor-quota__vm::DEBUG::2014-09-04 21:05:23,420::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >Dummy-41::DEBUG::2014-09-04 21:05:23,964::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/78390355-2a2d-41e5-aea5-fb426559f747/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-41::DEBUG::2014-09-04 21:05:24,328::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0128547 s, 79.7 MB/s\n'; <rc> = 0 >Dummy-41::DEBUG::2014-09-04 21:05:26,341::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/78390355-2a2d-41e5-aea5-fb426559f747/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-41::DEBUG::2014-09-04 21:05:26,719::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.012762 s, 80.2 MB/s\n'; <rc> = 0 >GuestMonitor-numa__test::DEBUG::2014-09-04 21:05:28,419::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >GuestMonitor-numa__test::DEBUG::2014-09-04 21:05:28,420::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >GuestMonitor-numa__test::DEBUG::2014-09-04 21:05:28,420::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >GuestMonitor-quota__vm::DEBUG::2014-09-04 21:05:28,426::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >GuestMonitor-quota__vm::DEBUG::2014-09-04 21:05:28,427::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >GuestMonitor-quota__vm::DEBUG::2014-09-04 21:05:28,427::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >Dummy-41::DEBUG::2014-09-04 21:05:28,755::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/78390355-2a2d-41e5-aea5-fb426559f747/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-41::DEBUG::2014-09-04 21:05:29,130::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0195289 s, 52.4 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-04 21:05:29,191::__init__::225::IOProcess::(_processLogs) Message size is 166 >Thread-14::DEBUG::2014-09-04 21:05:29,192::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:05:29,192::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:05:29,192::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:05:29,192::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:05:29,192::__init__::225::IOProcess::(_processLogs) (844225) Finding callback 'statvfs'... >Thread-14::DEBUG::2014-09-04 21:05:29,192::__init__::225::IOProcess::(_processLogs) (844225) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-04 21:05:29,193::__init__::225::IOProcess::(_processLogs) (844225) Building response >Thread-14::DEBUG::2014-09-04 21:05:29,193::__init__::225::IOProcess::(_processLogs) (844225) Queuing response >Thread-14::DEBUG::2014-09-04 21:05:29,193::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-17::DEBUG::2014-09-04 21:05:29,194::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_artyom__storage__rhevm__35/180c43ee-5baf-41b7-87c7-c0214b51fe8f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-09-04 21:05:29,522::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n474 bytes (474 B) copied, 0.000313627 s, 1.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-04 21:05:29,523::__init__::225::IOProcess::(_processLogs) Message size is 166 >Thread-14::DEBUG::2014-09-04 21:05:29,523::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:05:29,523::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:05:29,523::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:05:29,523::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:05:29,524::__init__::225::IOProcess::(_processLogs) (844226) Finding callback 'statvfs'... >Thread-14::DEBUG::2014-09-04 21:05:29,524::__init__::225::IOProcess::(_processLogs) (844226) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-04 21:05:29,524::__init__::225::IOProcess::(_processLogs) (844226) Building response >Thread-14::DEBUG::2014-09-04 21:05:29,524::__init__::225::IOProcess::(_processLogs) (844226) Queuing response >Thread-14::DEBUG::2014-09-04 21:05:29,524::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:05:29,525::__init__::225::IOProcess::(_processLogs) Message size is 183 >Thread-14::DEBUG::2014-09-04 21:05:29,525::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:05:29,526::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:05:29,526::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:05:29,526::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:05:29,526::__init__::225::IOProcess::(_processLogs) (844227) Finding callback 'access'... >Thread-14::DEBUG::2014-09-04 21:05:29,526::__init__::225::IOProcess::(_processLogs) (844227) Got request for method 'access' >Thread-14::DEBUG::2014-09-04 21:05:29,526::__init__::225::IOProcess::(_processLogs) (844227) Building response >Thread-14::DEBUG::2014-09-04 21:05:29,526::__init__::225::IOProcess::(_processLogs) (844227) Queuing response >Thread-14::DEBUG::2014-09-04 21:05:29,526::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:05:29,527::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-14::DEBUG::2014-09-04 21:05:29,527::__init__::225::IOProcess::(_processLogs) Message size is 187 >Thread-14::DEBUG::2014-09-04 21:05:29,527::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:05:29,528::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:05:29,528::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:05:29,528::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:05:29,528::__init__::225::IOProcess::(_processLogs) (844228) Finding callback 'access'... >Thread-14::DEBUG::2014-09-04 21:05:29,528::__init__::225::IOProcess::(_processLogs) (844228) Got request for method 'access' >Thread-14::DEBUG::2014-09-04 21:05:29,528::__init__::225::IOProcess::(_processLogs) (844228) Queuing response >Thread-14::DEBUG::2014-09-04 21:05:29,528::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:05:29,528::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-14::DEBUG::2014-09-04 21:05:29,529::__init__::225::IOProcess::(_processLogs) Message size is 189 >Thread-14::DEBUG::2014-09-04 21:05:29,529::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:05:29,529::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:05:29,529::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:05:29,530::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:05:29,530::__init__::225::IOProcess::(_processLogs) (844229) Finding callback 'access'... >Thread-14::DEBUG::2014-09-04 21:05:29,530::__init__::225::IOProcess::(_processLogs) (844229) Got request for method 'access' >Thread-14::DEBUG::2014-09-04 21:05:29,530::__init__::225::IOProcess::(_processLogs) (844229) Queuing response >Thread-14::DEBUG::2014-09-04 21:05:29,530::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:05:29,530::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-41::DEBUG::2014-09-04 21:05:31,144::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/78390355-2a2d-41e5-aea5-fb426559f747/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-41::DEBUG::2014-09-04 21:05:31,914::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.189646 s, 5.4 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-09-04 21:05:32,800::domainMonitor::209::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6 >Thread-14::DEBUG::2014-09-04 21:05:32,812::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-14::DEBUG::2014-09-04 21:05:32,813::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:05:32,813::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-04 21:05:32,813::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:05:32,814::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:05:32,814::__init__::225::IOProcess::(_processLogs) (844230) Finding callback 'glob'... >Thread-14::DEBUG::2014-09-04 21:05:32,814::__init__::225::IOProcess::(_processLogs) (844230) Got request for method 'glob' >Thread-14::DEBUG::2014-09-04 21:05:32,814::__init__::225::IOProcess::(_processLogs) Message size is 127 >Thread-14::DEBUG::2014-09-04 21:05:32,814::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:05:32,815::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:05:32,815::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:05:32,815::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:05:32,815::__init__::225::IOProcess::(_processLogs) (844231) Finding callback 'glob'... >Thread-14::DEBUG::2014-09-04 21:05:32,815::__init__::225::IOProcess::(_processLogs) (844231) Got request for method 'glob' >Thread-14::DEBUG::2014-09-04 21:05:32,815::__init__::225::IOProcess::(_processLogs) (844230) Queuing response >Thread-14::DEBUG::2014-09-04 21:05:32,815::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:05:32,815::__init__::225::IOProcess::(_processLogs) Sending response sized 220 >Thread-14::DEBUG::2014-09-04 21:05:32,816::__init__::225::IOProcess::(_processLogs) (844231) Building response >Thread-14::DEBUG::2014-09-04 21:05:32,816::__init__::225::IOProcess::(_processLogs) (844231) Queuing response >Thread-14::DEBUG::2014-09-04 21:05:32,816::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:05:32,816::__init__::225::IOProcess::(_processLogs) Sending response sized 177 >Thread-14::DEBUG::2014-09-04 21:05:32,816::__init__::225::IOProcess::(_processLogs) Receiving request... >Thread-14::DEBUG::2014-09-04 21:05:32,817::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:05:32,819::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-04 21:05:32,820::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:05:32,821::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:05:32,823::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:05:32,824::__init__::225::IOProcess::(_processLogs) (844232) Finding callback 'glob'... >Thread-14::DEBUG::2014-09-04 21:05:32,825::__init__::225::IOProcess::(_processLogs) (844232) Got request for method 'glob' >Thread-14::DEBUG::2014-09-04 21:05:32,826::__init__::225::IOProcess::(_processLogs) (844232) Building response >Thread-14::DEBUG::2014-09-04 21:05:32,829::__init__::225::IOProcess::(_processLogs) (844232) Queuing response >Thread-14::DEBUG::2014-09-04 21:05:32,830::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:05:32,832::__init__::225::IOProcess::(_processLogs) Sending response sized 196 >Thread-18::DEBUG::2014-09-04 21:05:32,839::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_qa_shared__iso__domain/7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6 >Thread-14::DEBUG::2014-09-04 21:05:32,839::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-14::DEBUG::2014-09-04 21:05:32,841::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:05:32,841::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-04 21:05:32,841::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:05:32,841::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:05:32,841::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:05:32,841::__init__::225::IOProcess::(_processLogs) (844233) Finding callback 'statvfs'... >Thread-14::DEBUG::2014-09-04 21:05:32,842::__init__::225::IOProcess::(_processLogs) (844233) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-04 21:05:32,842::__init__::225::IOProcess::(_processLogs) (844233) Building response >Thread-14::DEBUG::2014-09-04 21:05:32,842::__init__::225::IOProcess::(_processLogs) (844233) Queuing response >Thread-14::DEBUG::2014-09-04 21:05:32,842::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:05:32,842::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-10379::DEBUG::2014-09-04 21:05:32,844::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mavital/7ad04229-b793-4f73-ad10-5e41a4e836ff/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-14::DEBUG::2014-09-04 21:05:32,844::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-14::DEBUG::2014-09-04 21:05:33,180::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14054::DEBUG::2014-09-04 21:05:33,187::BindingXMLRPC::318::vds::(wrapper) client [10.35.163.104] flowID [73016284] >Thread-14::DEBUG::2014-09-04 21:05:33,189::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-10379::DEBUG::2014-09-04 21:05:33,190::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n339 bytes (339 B) copied, 0.000318069 s, 1.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-04 21:05:33,195::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14054::DEBUG::2014-09-04 21:05:33,196::task::595::Storage.TaskManager.Task::(_updateState) Task=`a98e7d2a-eedf-48d4-9492-a1d0dd1234d8`::moving from state init -> state preparing >Thread-14::DEBUG::2014-09-04 21:05:33,199::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:05:33,201::__init__::225::IOProcess::(_processLogs) (844234) Finding callback 'touch'... >Thread-14054::INFO::2014-09-04 21:05:33,201::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='78390355-2a2d-41e5-aea5-fb426559f747', options=None) >Thread-14::DEBUG::2014-09-04 21:05:33,204::__init__::225::IOProcess::(_processLogs) (844234) Got request for method 'touch' >Thread-14::DEBUG::2014-09-04 21:05:33,206::__init__::225::IOProcess::(_processLogs) (844234) Building response >Thread-14::DEBUG::2014-09-04 21:05:33,207::__init__::225::IOProcess::(_processLogs) (844234) Queuing response >Thread-14::DEBUG::2014-09-04 21:05:33,209::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:05:33,210::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-14::DEBUG::2014-09-04 21:05:33,215::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-09-04 21:05:33,215::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-14054::INFO::2014-09-04 21:05:33,218::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 8L}} >Thread-14::DEBUG::2014-09-04 21:05:33,219::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:05:33,223::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14054::DEBUG::2014-09-04 21:05:33,223::task::1191::Storage.TaskManager.Task::(prepare) Task=`a98e7d2a-eedf-48d4-9492-a1d0dd1234d8`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 8L}} >Thread-14::DEBUG::2014-09-04 21:05:33,225::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14054::DEBUG::2014-09-04 21:05:33,225::task::595::Storage.TaskManager.Task::(_updateState) Task=`a98e7d2a-eedf-48d4-9492-a1d0dd1234d8`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-09-04 21:05:33,228::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14054::DEBUG::2014-09-04 21:05:33,229::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-09-04 21:05:33,231::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14054::DEBUG::2014-09-04 21:05:33,232::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-09-04 21:05:33,233::__init__::225::IOProcess::(_processLogs) (844235) Finding callback 'statvfs'... >Thread-14054::DEBUG::2014-09-04 21:05:33,236::task::993::Storage.TaskManager.Task::(_decref) Task=`a98e7d2a-eedf-48d4-9492-a1d0dd1234d8`::ref 0 aborting False >Thread-14::DEBUG::2014-09-04 21:05:33,236::__init__::225::IOProcess::(_processLogs) (844235) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-04 21:05:33,239::__init__::225::IOProcess::(_processLogs) (844235) Queuing response >Thread-14::DEBUG::2014-09-04 21:05:33,240::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:05:33,241::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-14::DEBUG::2014-09-04 21:05:33,246::__init__::225::IOProcess::(_processLogs) Message size is 223 >Thread-14::DEBUG::2014-09-04 21:05:33,247::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:05:33,247::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-04 21:05:33,247::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:05:33,247::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:05:33,247::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:05:33,248::__init__::225::IOProcess::(_processLogs) (844236) Finding callback 'readfile'... >Thread-14::DEBUG::2014-09-04 21:05:33,248::__init__::225::IOProcess::(_processLogs) (844236) Got request for method 'readfile' >Thread-14::DEBUG::2014-09-04 21:05:33,249::__init__::225::IOProcess::(_processLogs) (844236) Queuing response >Thread-14::DEBUG::2014-09-04 21:05:33,249::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:05:33,249::__init__::225::IOProcess::(_processLogs) Sending response sized 2182 >Thread-18::DEBUG::2014-09-04 21:05:33,250::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Iso', 'DESCRIPTION=shared_iso_domain', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=907f3940-114c-46ac-9c10-efb0158ef5ac,70d9979d-05c9-4361-8170-accdf7580f62,eb00b845-2432-471a-a517-b1b021c31fe0,17b0026b-cecd-4f96-b468-5b279faccac7,b25217df-20a2-4a79-b41d-08b7c52deea7,81e32625-2551-4d87-b2c3-94a8c8e10905,2f071ff6-b87c-45da-9211-94084ad8028a,39a01c63-e44e-4f2e-8639-c77f7da130b6,32a72841-4a5d-4dc2-92ed-193b12fd90b5,3b38cfb6-abd8-45c7-bcc8-20ebebca98e1,8178a6d7-dfef-480e-8a9b-37a69766d2e8,526683e4-bfcc-4fdc-bfc9-cb824861334f,d13456fe-2c94-41f5-b0b9-6871f3e6cfa2,dc5fea1c-54e9-4503-9a21-80e8bed4dada,00000002-0002-0002-0002-00000000005a,21149729-f80b-484e-9e83-29b877e356ad,974e3ac3-bad8-493b-9ef1-645841c1d498,f1b9906a-bcbb-465d-ac04-f6900e563919,e7a8ab56-bf5a-4262-8603-9222ae7421d9,00000002-0002-0002-0002-0000000003b4,25878d1e-4d4c-4abe-8c74-2aa1f7286e93,b393cdb9-1676-4056-b9e3-5cb3a2480f48,08e8900d-95c2-4733-ab61-8a9a55e2f472,5bc7f683-4dc7-4db0-bb8c-f74991202b36,6b2c4b55-e45b-4d25-a47c-fae3264244b9,7311bc97-09f9-40e4-ade4-148c297ac795,11d24a11-3769-45ac-83ed-250ad6c4c866,de0aeb76-90f8-4637-aa76-a891a5fcc295,680c2205-df7d-40db-980a-a35f716e533e,9188cbc3-47ef-4483-80ef-6c62bc0d9a75,72203f29-3d24-41d4-9534-0720cc0d1edc,f04a172d-b46b-4547-bcbb-846751574309,00000002-0002-0002-0002-000000000023', 'REMOTE_PATH=multipass.eng.lab.tlv.redhat.com:/export/images/qa/shared_iso_domain', 'ROLE=Regular', 'SDUUID=7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=9c945936e52419ed2943ddab0bb06de59626b5ac'] >Thread-14::DEBUG::2014-09-04 21:05:33,251::__init__::225::IOProcess::(_processLogs) Message size is 216 >Thread-14::DEBUG::2014-09-04 21:05:33,251::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:05:33,251::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:05:33,251::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:05:33,251::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:05:33,251::__init__::225::IOProcess::(_processLogs) (844237) Finding callback 'access'... >Thread-14::DEBUG::2014-09-04 21:05:33,251::__init__::225::IOProcess::(_processLogs) (844237) Got request for method 'access' >Thread-14::DEBUG::2014-09-04 21:05:33,252::__init__::225::IOProcess::(_processLogs) (844237) Building response >Thread-14::DEBUG::2014-09-04 21:05:33,252::__init__::225::IOProcess::(_processLogs) (844237) Queuing response >Thread-14::DEBUG::2014-09-04 21:05:33,252::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:05:33,252::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-14::DEBUG::2014-09-04 21:05:33,252::__init__::225::IOProcess::(_processLogs) Message size is 210 >Thread-14::DEBUG::2014-09-04 21:05:33,253::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:05:33,253::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:05:33,253::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:05:33,253::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:05:33,253::__init__::225::IOProcess::(_processLogs) (844238) Finding callback 'glob'... >Thread-14::DEBUG::2014-09-04 21:05:33,253::__init__::225::IOProcess::(_processLogs) (844238) Got request for method 'glob' >Thread-14::DEBUG::2014-09-04 21:05:33,254::__init__::225::IOProcess::(_processLogs) (844238) Queuing response >Thread-14::DEBUG::2014-09-04 21:05:33,255::__init__::225::IOProcess::(_processLogs) Sending response sized 78 >Thread-18::DEBUG::2014-09-04 21:05:33,257::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-43::DEBUG::2014-09-04 21:05:33,257::BindingXMLRPC::318::vds::(wrapper) client [10.35.163.104] flowID [73016284] >Thread-18::INFO::2014-09-04 21:05:33,258::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6_imageNS already registered >Thread-18::INFO::2014-09-04 21:05:33,259::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6_volumeNS already registered >Thread-43::DEBUG::2014-09-04 21:05:33,261::task::595::Storage.TaskManager.Task::(_updateState) Task=`6e4c3bac-4934-4cfa-8b23-fa57f789805d`::moving from state init -> state preparing >Thread-14::DEBUG::2014-09-04 21:05:33,261::__init__::225::IOProcess::(_processLogs) Message size is 190 >Thread-43::INFO::2014-09-04 21:05:33,262::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='78390355-2a2d-41e5-aea5-fb426559f747', options=None) >Thread-14::DEBUG::2014-09-04 21:05:33,263::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:05:33,264::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-04 21:05:33,265::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:05:33,266::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-43::DEBUG::2014-09-04 21:05:33,266::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.78390355-2a2d-41e5-aea5-fb426559f747`ReqID=`02873255-0eba-47f0-9a86-e2970a0996e2`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-14::DEBUG::2014-09-04 21:05:33,267::__init__::225::IOProcess::(_processLogs) (844239) Finding callback 'statvfs'... >Thread-43::DEBUG::2014-09-04 21:05:33,267::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.78390355-2a2d-41e5-aea5-fb426559f747' for lock type 'shared' >Thread-14::DEBUG::2014-09-04 21:05:33,268::__init__::225::IOProcess::(_processLogs) (844239) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-04 21:05:33,269::__init__::225::IOProcess::(_processLogs) (844239) Building response >Thread-43::DEBUG::2014-09-04 21:05:33,269::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.78390355-2a2d-41e5-aea5-fb426559f747' is free. Now locking as 'shared' (1 active user) >Thread-14::DEBUG::2014-09-04 21:05:33,270::__init__::225::IOProcess::(_processLogs) (844239) Queuing response >Thread-43::DEBUG::2014-09-04 21:05:33,270::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.78390355-2a2d-41e5-aea5-fb426559f747`ReqID=`02873255-0eba-47f0-9a86-e2970a0996e2`::Granted request >Thread-14::DEBUG::2014-09-04 21:05:33,271::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:05:33,272::__init__::225::IOProcess::(_processLogs) Sending response sized 329 >Thread-43::DEBUG::2014-09-04 21:05:33,273::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`6e4c3bac-4934-4cfa-8b23-fa57f789805d`::_resourcesAcquired: Storage.78390355-2a2d-41e5-aea5-fb426559f747 (shared) >Thread-43::DEBUG::2014-09-04 21:05:33,275::task::993::Storage.TaskManager.Task::(_decref) Task=`6e4c3bac-4934-4cfa-8b23-fa57f789805d`::ref 1 aborting False >Thread-18::DEBUG::2014-09-04 21:05:33,276::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_qa_shared__iso__domain/7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-18::DEBUG::2014-09-04 21:05:33,597::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1581 bytes (1.6 kB) copied, 0.000735695 s, 2.1 MB/s\n'; <rc> = 0 >GuestMonitor-quota__vm::DEBUG::2014-09-04 21:05:33,600::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >GuestMonitor-numa__test::DEBUG::2014-09-04 21:05:33,603::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >Thread-14::DEBUG::2014-09-04 21:05:33,608::__init__::225::IOProcess::(_processLogs) Message size is 190 >Thread-14::DEBUG::2014-09-04 21:05:33,612::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:05:33,616::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-04 21:05:33,620::__init__::225::IOProcess::(_processLogs) Waiting for next request... >GuestMonitor-quota__vm::DEBUG::2014-09-04 21:05:33,622::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >GuestMonitor-numa__test::DEBUG::2014-09-04 21:05:33,623::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >Thread-14::DEBUG::2014-09-04 21:05:33,624::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:05:33,628::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:05:33,631::__init__::225::IOProcess::(_processLogs) (844240) Finding callback 'statvfs'... >Thread-14::DEBUG::2014-09-04 21:05:33,636::__init__::225::IOProcess::(_processLogs) (844240) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-04 21:05:33,640::__init__::225::IOProcess::(_processLogs) (844240) Queuing response >GuestMonitor-quota__vm::DEBUG::2014-09-04 21:05:33,641::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >GuestMonitor-numa__test::DEBUG::2014-09-04 21:05:33,642::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >Thread-14::DEBUG::2014-09-04 21:05:33,643::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:05:33,647::__init__::225::IOProcess::(_processLogs) Sending response sized 329 >Thread-43::INFO::2014-09-04 21:05:33,670::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': u'/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_qa_shared__iso__domain/7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 8L, 'domains': '180c43ee-5baf-41b7-87c7-c0214b51fe8f:Active,7ad04229-b793-4f73-ad10-5e41a4e836ff:Active,7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6:Active', 'master_uuid': u'180c43ee-5baf-41b7-87c7-c0214b51fe8f', 'version': '3', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'180c43ee-5baf-41b7-87c7-c0214b51fe8f': {'status': 'Active', 'diskfree': '1820607315968', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246104576', 'version': 3}, '7ad04229-b793-4f73-ad10-5e41a4e836ff': {'status': 'Active', 'diskfree': '1820607315968', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246104576', 'version': 0}, '7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6': {'status': 'Active', 'diskfree': '18882756608', 'isoprefix': u'/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_qa_shared__iso__domain/7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '652611682304', 'version': 0}}} >Thread-43::DEBUG::2014-09-04 21:05:33,671::task::1191::Storage.TaskManager.Task::(prepare) Task=`6e4c3bac-4934-4cfa-8b23-fa57f789805d`::finished: {'info': {'name': 'No Description', 'isoprefix': u'/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_qa_shared__iso__domain/7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 8L, 'domains': '180c43ee-5baf-41b7-87c7-c0214b51fe8f:Active,7ad04229-b793-4f73-ad10-5e41a4e836ff:Active,7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6:Active', 'master_uuid': u'180c43ee-5baf-41b7-87c7-c0214b51fe8f', 'version': '3', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'180c43ee-5baf-41b7-87c7-c0214b51fe8f': {'status': 'Active', 'diskfree': '1820607315968', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246104576', 'version': 3}, '7ad04229-b793-4f73-ad10-5e41a4e836ff': {'status': 'Active', 'diskfree': '1820607315968', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246104576', 'version': 0}, '7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6': {'status': 'Active', 'diskfree': '18882756608', 'isoprefix': u'/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_qa_shared__iso__domain/7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '652611682304', 'version': 0}}} >Thread-43::DEBUG::2014-09-04 21:05:33,671::task::595::Storage.TaskManager.Task::(_updateState) Task=`6e4c3bac-4934-4cfa-8b23-fa57f789805d`::moving from state preparing -> state finished >Thread-43::DEBUG::2014-09-04 21:05:33,671::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.78390355-2a2d-41e5-aea5-fb426559f747': < ResourceRef 'Storage.78390355-2a2d-41e5-aea5-fb426559f747', isValid: 'True' obj: 'None'>} >Thread-43::DEBUG::2014-09-04 21:05:33,671::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-43::DEBUG::2014-09-04 21:05:33,671::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.78390355-2a2d-41e5-aea5-fb426559f747' >Thread-43::DEBUG::2014-09-04 21:05:33,672::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.78390355-2a2d-41e5-aea5-fb426559f747' (0 active users) >Thread-43::DEBUG::2014-09-04 21:05:33,672::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.78390355-2a2d-41e5-aea5-fb426559f747' is free, finding out if anyone is waiting for it. >Thread-43::DEBUG::2014-09-04 21:05:33,672::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.78390355-2a2d-41e5-aea5-fb426559f747', Clearing records. >Thread-43::DEBUG::2014-09-04 21:05:33,672::task::993::Storage.TaskManager.Task::(_decref) Task=`6e4c3bac-4934-4cfa-8b23-fa57f789805d`::ref 0 aborting False >Dummy-41::DEBUG::2014-09-04 21:05:33,947::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/78390355-2a2d-41e5-aea5-fb426559f747/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-41::DEBUG::2014-09-04 21:05:34,324::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0123701 s, 82.8 MB/s\n'; <rc> = 0 >Thread-14054::DEBUG::2014-09-04 21:05:35,824::task::595::Storage.TaskManager.Task::(_updateState) Task=`38958f24-0946-4841-a0ae-4cbdcc4faf33`::moving from state init -> state preparing >Thread-14054::INFO::2014-09-04 21:05:35,824::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14054::INFO::2014-09-04 21:05:35,825::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180c43ee-5baf-41b7-87c7-c0214b51fe8f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000313627', 'lastCheck': '6.3', 'valid': True}, '7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000735695', 'lastCheck': '2.2', 'valid': True}, '7ad04229-b793-4f73-ad10-5e41a4e836ff': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000318069', 'lastCheck': '2.6', 'valid': True}} >Thread-14054::DEBUG::2014-09-04 21:05:35,825::task::1191::Storage.TaskManager.Task::(prepare) Task=`38958f24-0946-4841-a0ae-4cbdcc4faf33`::finished: {'180c43ee-5baf-41b7-87c7-c0214b51fe8f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000313627', 'lastCheck': '6.3', 'valid': True}, '7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000735695', 'lastCheck': '2.2', 'valid': True}, '7ad04229-b793-4f73-ad10-5e41a4e836ff': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000318069', 'lastCheck': '2.6', 'valid': True}} >Thread-14054::DEBUG::2014-09-04 21:05:35,825::task::595::Storage.TaskManager.Task::(_updateState) Task=`38958f24-0946-4841-a0ae-4cbdcc4faf33`::moving from state preparing -> state finished >Thread-14054::DEBUG::2014-09-04 21:05:35,825::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14054::DEBUG::2014-09-04 21:05:35,825::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14054::DEBUG::2014-09-04 21:05:35,826::task::993::Storage.TaskManager.Task::(_decref) Task=`38958f24-0946-4841-a0ae-4cbdcc4faf33`::ref 0 aborting False >Thread-14054::DEBUG::2014-09-04 21:05:35,849::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >Thread-14054::DEBUG::2014-09-04 21:05:35,849::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >Dummy-41::DEBUG::2014-09-04 21:05:36,335::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/78390355-2a2d-41e5-aea5-fb426559f747/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-41::DEBUG::2014-09-04 21:05:36,699::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0126749 s, 80.8 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-09-04 21:05:38,290::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-09-04 21:05:38,290::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 57. >GuestMonitor-numa__test::DEBUG::2014-09-04 21:05:38,662::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >GuestMonitor-quota__vm::DEBUG::2014-09-04 21:05:38,663::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >GuestMonitor-numa__test::DEBUG::2014-09-04 21:05:38,667::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >GuestMonitor-quota__vm::DEBUG::2014-09-04 21:05:38,668::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >GuestMonitor-numa__test::DEBUG::2014-09-04 21:05:38,671::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >GuestMonitor-quota__vm::DEBUG::2014-09-04 21:05:38,673::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >Dummy-41::DEBUG::2014-09-04 21:05:38,711::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/78390355-2a2d-41e5-aea5-fb426559f747/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-41::DEBUG::2014-09-04 21:05:39,077::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0126674 s, 80.8 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-04 21:05:39,532::__init__::225::IOProcess::(_processLogs) Message size is 166 >Thread-14::DEBUG::2014-09-04 21:05:39,533::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:05:39,533::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:05:39,533::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:05:39,533::__init__::225::IOProcess::(_processLogs) (844241) Finding callback 'statvfs'... >Thread-14::DEBUG::2014-09-04 21:05:39,533::__init__::225::IOProcess::(_processLogs) (844241) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-04 21:05:39,533::__init__::225::IOProcess::(_processLogs) (844241) Queuing response >Thread-14::DEBUG::2014-09-04 21:05:39,533::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:05:39,534::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-17::DEBUG::2014-09-04 21:05:39,534::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_artyom__storage__rhevm__35/180c43ee-5baf-41b7-87c7-c0214b51fe8f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-09-04 21:05:39,863::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n474 bytes (474 B) copied, 0.000331694 s, 1.4 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-04 21:05:39,867::__init__::225::IOProcess::(_processLogs) Message size is 166 >Thread-14::DEBUG::2014-09-04 21:05:39,868::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:05:39,870::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-04 21:05:39,870::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:05:39,872::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:05:39,873::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:05:39,874::__init__::225::IOProcess::(_processLogs) (844242) Finding callback 'statvfs'... >Thread-14::DEBUG::2014-09-04 21:05:39,875::__init__::225::IOProcess::(_processLogs) (844242) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-04 21:05:39,876::__init__::225::IOProcess::(_processLogs) (844242) Queuing response >Thread-14::DEBUG::2014-09-04 21:05:39,877::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:05:39,878::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-14::DEBUG::2014-09-04 21:05:39,885::__init__::225::IOProcess::(_processLogs) Message size is 183 >Thread-14::DEBUG::2014-09-04 21:05:39,886::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:05:39,887::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-04 21:05:39,888::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:05:39,889::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:05:39,891::__init__::225::IOProcess::(_processLogs) (844243) Finding callback 'access'... >Thread-14::DEBUG::2014-09-04 21:05:39,892::__init__::225::IOProcess::(_processLogs) (844243) Got request for method 'access' >Thread-14::DEBUG::2014-09-04 21:05:39,893::__init__::225::IOProcess::(_processLogs) (844243) Building response >Thread-14::DEBUG::2014-09-04 21:05:39,896::__init__::225::IOProcess::(_processLogs) (844243) Queuing response >Thread-14::DEBUG::2014-09-04 21:05:39,897::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:05:39,898::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-14::DEBUG::2014-09-04 21:05:39,901::__init__::225::IOProcess::(_processLogs) Message size is 187 >Thread-14::DEBUG::2014-09-04 21:05:39,902::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:05:39,904::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-04 21:05:39,905::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:05:39,906::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:05:39,907::__init__::225::IOProcess::(_processLogs) (844244) Finding callback 'access'... >Thread-14::DEBUG::2014-09-04 21:05:39,908::__init__::225::IOProcess::(_processLogs) (844244) Got request for method 'access' >Thread-14::DEBUG::2014-09-04 21:05:39,909::__init__::225::IOProcess::(_processLogs) (844244) Building response >Thread-14::DEBUG::2014-09-04 21:05:39,910::__init__::225::IOProcess::(_processLogs) (844244) Queuing response >Thread-14::DEBUG::2014-09-04 21:05:39,911::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:05:39,912::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-14::DEBUG::2014-09-04 21:05:39,915::__init__::225::IOProcess::(_processLogs) Message size is 189 >Thread-14::DEBUG::2014-09-04 21:05:39,916::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:05:39,917::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-04 21:05:39,918::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:05:39,919::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:05:39,921::__init__::225::IOProcess::(_processLogs) (844245) Finding callback 'access'... >Thread-14::DEBUG::2014-09-04 21:05:39,922::__init__::225::IOProcess::(_processLogs) (844245) Got request for method 'access' >Thread-14::DEBUG::2014-09-04 21:05:39,923::__init__::225::IOProcess::(_processLogs) (844245) Building response >Thread-14::DEBUG::2014-09-04 21:05:39,924::__init__::225::IOProcess::(_processLogs) (844245) Queuing response >Thread-14::DEBUG::2014-09-04 21:05:39,925::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:05:39,925::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-41::DEBUG::2014-09-04 21:05:41,088::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/78390355-2a2d-41e5-aea5-fb426559f747/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-41::DEBUG::2014-09-04 21:05:41,459::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0185591 s, 55.2 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-04 21:05:43,252::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-14::DEBUG::2014-09-04 21:05:43,253::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:05:43,253::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:05:43,253::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:05:43,253::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:05:43,253::__init__::225::IOProcess::(_processLogs) (844246) Finding callback 'statvfs'... >Thread-14::DEBUG::2014-09-04 21:05:43,254::__init__::225::IOProcess::(_processLogs) (844246) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-04 21:05:43,254::__init__::225::IOProcess::(_processLogs) (844246) Building response >Thread-14::DEBUG::2014-09-04 21:05:43,254::__init__::225::IOProcess::(_processLogs) (844246) Queuing response >Thread-14::DEBUG::2014-09-04 21:05:43,254::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:05:43,254::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-10379::DEBUG::2014-09-04 21:05:43,255::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mavital/7ad04229-b793-4f73-ad10-5e41a4e836ff/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Dummy-41::DEBUG::2014-09-04 21:05:43,932::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/78390355-2a2d-41e5-aea5-fb426559f747/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-14054::DEBUG::2014-09-04 21:05:44,255::BindingXMLRPC::318::vds::(wrapper) client [10.35.163.104] >Thread-14::DEBUG::2014-09-04 21:05:44,259::__init__::225::IOProcess::(_processLogs) Message size is 190 >Thread-10379::DEBUG::2014-09-04 21:05:44,259::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n339 bytes (339 B) copied, 0.000395798 s, 856 kB/s\n'; <rc> = 0 >GuestMonitor-quota__vm::DEBUG::2014-09-04 21:05:44,260::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >GuestMonitor-numa__test::DEBUG::2014-09-04 21:05:44,266::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >Thread-14::DEBUG::2014-09-04 21:05:44,271::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14054::DEBUG::2014-09-04 21:05:44,276::task::595::Storage.TaskManager.Task::(_updateState) Task=`95f56ba1-6b33-49b0-84cd-038f24357c9d`::moving from state init -> state preparing >Thread-14::DEBUG::2014-09-04 21:05:44,282::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14054::INFO::2014-09-04 21:05:44,284::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='78390355-2a2d-41e5-aea5-fb426559f747', options=None) >Thread-14::DEBUG::2014-09-04 21:05:44,289::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:05:44,299::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >GuestMonitor-quota__vm::DEBUG::2014-09-04 21:05:44,305::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >Thread-14054::INFO::2014-09-04 21:05:44,305::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 8L}} >Thread-14::DEBUG::2014-09-04 21:05:44,307::__init__::225::IOProcess::(_processLogs) Extracting request information... >GuestMonitor-numa__test::DEBUG::2014-09-04 21:05:44,307::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >Thread-14::DEBUG::2014-09-04 21:05:44,314::__init__::225::IOProcess::(_processLogs) (844247) Finding callback 'statvfs'... >Thread-14054::DEBUG::2014-09-04 21:05:44,313::task::1191::Storage.TaskManager.Task::(prepare) Task=`95f56ba1-6b33-49b0-84cd-038f24357c9d`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 8L}} >Thread-14054::DEBUG::2014-09-04 21:05:44,321::task::595::Storage.TaskManager.Task::(_updateState) Task=`95f56ba1-6b33-49b0-84cd-038f24357c9d`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-09-04 21:05:44,321::__init__::225::IOProcess::(_processLogs) (844247) Got request for method 'statvfs' >Thread-14054::DEBUG::2014-09-04 21:05:44,327::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-09-04 21:05:44,332::__init__::225::IOProcess::(_processLogs) (844247) Queuing response >Thread-14054::DEBUG::2014-09-04 21:05:44,333::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >GuestMonitor-quota__vm::DEBUG::2014-09-04 21:05:44,335::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >GuestMonitor-numa__test::DEBUG::2014-09-04 21:05:44,338::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >Thread-14::DEBUG::2014-09-04 21:05:44,339::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14054::DEBUG::2014-09-04 21:05:44,341::task::993::Storage.TaskManager.Task::(_decref) Task=`95f56ba1-6b33-49b0-84cd-038f24357c9d`::ref 0 aborting False >Thread-14::DEBUG::2014-09-04 21:05:44,347::__init__::225::IOProcess::(_processLogs) Sending response sized 329 >Thread-14::DEBUG::2014-09-04 21:05:44,369::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-18::DEBUG::2014-09-04 21:05:44,371::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_qa_shared__iso__domain/7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-14::DEBUG::2014-09-04 21:05:44,372::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:05:44,706::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-43::DEBUG::2014-09-04 21:05:44,713::BindingXMLRPC::318::vds::(wrapper) client [10.35.163.104] >Thread-14::DEBUG::2014-09-04 21:05:44,713::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-18::DEBUG::2014-09-04 21:05:44,713::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1581 bytes (1.6 kB) copied, 0.000399333 s, 4.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-04 21:05:44,718::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-43::DEBUG::2014-09-04 21:05:44,720::task::595::Storage.TaskManager.Task::(_updateState) Task=`f318d35c-fc5a-4558-a329-798f201c666d`::moving from state init -> state preparing >Thread-14::DEBUG::2014-09-04 21:05:44,722::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-43::INFO::2014-09-04 21:05:44,723::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='78390355-2a2d-41e5-aea5-fb426559f747', options=None) >Thread-14::DEBUG::2014-09-04 21:05:44,725::__init__::225::IOProcess::(_processLogs) (844248) Finding callback 'statvfs'... >Thread-14::DEBUG::2014-09-04 21:05:44,729::__init__::225::IOProcess::(_processLogs) (844248) Got request for method 'statvfs' >Thread-43::DEBUG::2014-09-04 21:05:44,766::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.78390355-2a2d-41e5-aea5-fb426559f747`ReqID=`19f09608-8743-4eb6-aa4e-9ca061c4efd6`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-14::DEBUG::2014-09-04 21:05:44,767::__init__::225::IOProcess::(_processLogs) (844248) Queuing response >Dummy-41::DEBUG::2014-09-04 21:05:44,768::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.46997 s, 2.2 MB/s\n'; <rc> = 0 >Thread-43::DEBUG::2014-09-04 21:05:44,769::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.78390355-2a2d-41e5-aea5-fb426559f747' for lock type 'shared' >Thread-14::DEBUG::2014-09-04 21:05:44,770::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-43::DEBUG::2014-09-04 21:05:44,773::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.78390355-2a2d-41e5-aea5-fb426559f747' is free. Now locking as 'shared' (1 active user) >Thread-14::DEBUG::2014-09-04 21:05:44,773::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-43::DEBUG::2014-09-04 21:05:44,776::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.78390355-2a2d-41e5-aea5-fb426559f747`ReqID=`19f09608-8743-4eb6-aa4e-9ca061c4efd6`::Granted request >Thread-43::DEBUG::2014-09-04 21:05:44,783::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`f318d35c-fc5a-4558-a329-798f201c666d`::_resourcesAcquired: Storage.78390355-2a2d-41e5-aea5-fb426559f747 (shared) >Thread-43::DEBUG::2014-09-04 21:05:44,787::task::993::Storage.TaskManager.Task::(_decref) Task=`f318d35c-fc5a-4558-a329-798f201c666d`::ref 1 aborting False >Thread-14::DEBUG::2014-09-04 21:05:44,788::__init__::225::IOProcess::(_processLogs) Message size is 190 >Thread-14::DEBUG::2014-09-04 21:05:44,792::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:05:44,795::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-04 21:05:44,798::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:05:44,801::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:05:44,805::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:05:44,808::__init__::225::IOProcess::(_processLogs) (844249) Finding callback 'statvfs'... >Thread-14::DEBUG::2014-09-04 21:05:44,811::__init__::225::IOProcess::(_processLogs) (844249) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-04 21:05:44,814::__init__::225::IOProcess::(_processLogs) (844249) Queuing response >Thread-14::DEBUG::2014-09-04 21:05:44,817::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:05:44,820::__init__::225::IOProcess::(_processLogs) Sending response sized 329 >Thread-43::INFO::2014-09-04 21:05:44,855::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': u'/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_qa_shared__iso__domain/7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 8L, 'domains': '180c43ee-5baf-41b7-87c7-c0214b51fe8f:Active,7ad04229-b793-4f73-ad10-5e41a4e836ff:Active,7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6:Active', 'master_uuid': u'180c43ee-5baf-41b7-87c7-c0214b51fe8f', 'version': '3', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'180c43ee-5baf-41b7-87c7-c0214b51fe8f': {'status': 'Active', 'diskfree': '1820607315968', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246104576', 'version': 3}, '7ad04229-b793-4f73-ad10-5e41a4e836ff': {'status': 'Active', 'diskfree': '1820607315968', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246104576', 'version': 0}, '7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6': {'status': 'Active', 'diskfree': '18882756608', 'isoprefix': u'/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_qa_shared__iso__domain/7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '652611682304', 'version': 0}}} >Thread-43::DEBUG::2014-09-04 21:05:44,855::task::1191::Storage.TaskManager.Task::(prepare) Task=`f318d35c-fc5a-4558-a329-798f201c666d`::finished: {'info': {'name': 'No Description', 'isoprefix': u'/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_qa_shared__iso__domain/7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 8L, 'domains': '180c43ee-5baf-41b7-87c7-c0214b51fe8f:Active,7ad04229-b793-4f73-ad10-5e41a4e836ff:Active,7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6:Active', 'master_uuid': u'180c43ee-5baf-41b7-87c7-c0214b51fe8f', 'version': '3', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'180c43ee-5baf-41b7-87c7-c0214b51fe8f': {'status': 'Active', 'diskfree': '1820607315968', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246104576', 'version': 3}, '7ad04229-b793-4f73-ad10-5e41a4e836ff': {'status': 'Active', 'diskfree': '1820607315968', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246104576', 'version': 0}, '7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6': {'status': 'Active', 'diskfree': '18882756608', 'isoprefix': u'/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_qa_shared__iso__domain/7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '652611682304', 'version': 0}}} >Thread-43::DEBUG::2014-09-04 21:05:44,855::task::595::Storage.TaskManager.Task::(_updateState) Task=`f318d35c-fc5a-4558-a329-798f201c666d`::moving from state preparing -> state finished >Thread-43::DEBUG::2014-09-04 21:05:44,856::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.78390355-2a2d-41e5-aea5-fb426559f747': < ResourceRef 'Storage.78390355-2a2d-41e5-aea5-fb426559f747', isValid: 'True' obj: 'None'>} >Thread-43::DEBUG::2014-09-04 21:05:44,856::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-43::DEBUG::2014-09-04 21:05:44,856::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.78390355-2a2d-41e5-aea5-fb426559f747' >Thread-43::DEBUG::2014-09-04 21:05:44,856::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.78390355-2a2d-41e5-aea5-fb426559f747' (0 active users) >Thread-43::DEBUG::2014-09-04 21:05:44,856::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.78390355-2a2d-41e5-aea5-fb426559f747' is free, finding out if anyone is waiting for it. >Thread-43::DEBUG::2014-09-04 21:05:44,856::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.78390355-2a2d-41e5-aea5-fb426559f747', Clearing records. >Thread-43::DEBUG::2014-09-04 21:05:44,857::task::993::Storage.TaskManager.Task::(_decref) Task=`f318d35c-fc5a-4558-a329-798f201c666d`::ref 0 aborting False >Dummy-41::DEBUG::2014-09-04 21:05:46,848::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/78390355-2a2d-41e5-aea5-fb426559f747/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-41::DEBUG::2014-09-04 21:05:47,213::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0129548 s, 79.0 MB/s\n'; <rc> = 0 >Thread-9196::DEBUG::2014-09-04 21:05:47,930::task::595::Storage.TaskManager.Task::(_updateState) Task=`068890a0-19b1-4b9a-a026-47ed36d84510`::moving from state init -> state preparing >Thread-9196::INFO::2014-09-04 21:05:47,930::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='180c43ee-5baf-41b7-87c7-c0214b51fe8f', spUUID='78390355-2a2d-41e5-aea5-fb426559f747', imgUUID='e8bb0473-2d86-4f1c-9d82-2c9690c52427', volUUID='bed5a4ba-eae0-49bf-a6b2-be81e7c21100', options=None) >Thread-14::DEBUG::2014-09-04 21:05:47,931::__init__::225::IOProcess::(_processLogs) Message size is 244 >Thread-14::DEBUG::2014-09-04 21:05:47,931::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:05:47,931::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-04 21:05:47,931::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:05:47,932::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:05:47,932::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Extracting request information... >Thread-14::DEBUG::2014-09-04 21:05:47,932::__init__::225::IOProcess::(_processLogs) (844250) Finding callback 'stat'... >Thread-14::DEBUG::2014-09-04 21:05:47,932::__init__::225::IOProcess::(_processLogs) (844250) Got request for method 'stat' >Thread-14::DEBUG::2014-09-04 21:05:47,932::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(844250) Building response >Thread-14::DEBUG::2014-09-04 21:05:47,932::__init__::225::IOProcess::(_processLogs) (844250) Queuing response >Thread-14::DEBUG::2014-09-04 21:05:47,932::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:05:47,932::__init__::225::IOProcess::(_processLogs) Sending response sized 327 >Thread-14::DEBUG::2014-09-04 21:05:47,934::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-14::DEBUG::2014-09-04 21:05:47,934::__init__::225::IOProcess::(_processLogs) Message size is 244 >Thread-14::DEBUG::2014-09-04 21:05:47,934::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:05:47,934::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-14::DEBUG::2014-09-04 21:05:47,934::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:05:47,934::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:05:47,934::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:05:47,934::__init__::225::IOProcess::(_processLogs) (844251) Finding callback 'stat'... >Thread-14::DEBUG::2014-09-04 21:05:47,935::__init__::225::IOProcess::(_processLogs) (844251) Got request for method 'stat' >Thread-14::DEBUG::2014-09-04 21:05:47,935::__init__::225::IOProcess::(_processLogs) (844251) Building response >Thread-14::DEBUG::2014-09-04 21:05:47,935::__init__::225::IOProcess::(_processLogs) (844251) Queuing response >Thread-14::DEBUG::2014-09-04 21:05:47,935::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:05:47,935::__init__::225::IOProcess::(_processLogs) Sending response sized 327 >Thread-9196::INFO::2014-09-04 21:05:47,936::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '24576', 'apparentsize': '1073741824'} >Thread-9196::DEBUG::2014-09-04 21:05:47,936::task::1191::Storage.TaskManager.Task::(prepare) Task=`068890a0-19b1-4b9a-a026-47ed36d84510`::finished: {'truesize': '24576', 'apparentsize': '1073741824'} >Thread-9196::DEBUG::2014-09-04 21:05:47,936::task::595::Storage.TaskManager.Task::(_updateState) Task=`068890a0-19b1-4b9a-a026-47ed36d84510`::moving from state preparing -> state finished >Thread-9196::DEBUG::2014-09-04 21:05:47,936::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-9196::DEBUG::2014-09-04 21:05:47,936::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-9196::DEBUG::2014-09-04 21:05:47,936::task::993::Storage.TaskManager.Task::(_decref) Task=`068890a0-19b1-4b9a-a026-47ed36d84510`::ref 0 aborting False >Dummy-41::DEBUG::2014-09-04 21:05:49,229::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/78390355-2a2d-41e5-aea5-fb426559f747/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >GuestMonitor-numa__test::DEBUG::2014-09-04 21:05:49,757::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >GuestMonitor-quota__vm::DEBUG::2014-09-04 21:05:49,760::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >GuestMonitor-numa__test::DEBUG::2014-09-04 21:05:49,771::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >GuestMonitor-quota__vm::DEBUG::2014-09-04 21:05:49,774::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >GuestMonitor-numa__test::DEBUG::2014-09-04 21:05:49,781::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >GuestMonitor-quota__vm::DEBUG::2014-09-04 21:05:49,785::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >Dummy-41::DEBUG::2014-09-04 21:05:49,828::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.229868 s, 4.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-04 21:05:49,930::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-14::DEBUG::2014-09-04 21:05:49,930::__init__::225::IOProcess::(_processLogs) Message size is 166 >Thread-14::DEBUG::2014-09-04 21:05:49,930::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:05:49,931::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-14::DEBUG::2014-09-04 21:05:49,931::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:05:49,931::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:05:49,931::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:05:49,931::__init__::225::IOProcess::(_processLogs) (844252) Finding callback 'statvfs'... >Thread-14::DEBUG::2014-09-04 21:05:49,931::__init__::225::IOProcess::(_processLogs) (844252) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-04 21:05:49,931::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(844252) Building response >Thread-14::DEBUG::2014-09-04 21:05:49,932::__init__::225::IOProcess::(_processLogs) (844252) Queuing response >Thread-14::DEBUG::2014-09-04 21:05:49,932::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:05:49,932::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-17::DEBUG::2014-09-04 21:05:49,933::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_artyom__storage__rhevm__35/180c43ee-5baf-41b7-87c7-c0214b51fe8f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-09-04 21:05:50,271::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n474 bytes (474 B) copied, 0.000352138 s, 1.3 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-04 21:05:50,275::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-14::DEBUG::2014-09-04 21:05:50,277::__init__::225::IOProcess::(_processLogs) Message size is 166 >Thread-14::DEBUG::2014-09-04 21:05:50,278::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:05:50,279::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-04 21:05:50,280::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:05:50,281::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:05:50,283::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:05:50,284::__init__::225::IOProcess::(_processLogs) (844253) Finding callback 'statvfs'... >Thread-14::DEBUG::2014-09-04 21:05:50,285::__init__::225::IOProcess::(_processLogs) (844253) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-04 21:05:50,286::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(844253) Building response >Thread-14::DEBUG::2014-09-04 21:05:50,287::__init__::225::IOProcess::(_processLogs) (844253) Queuing response >Thread-14::DEBUG::2014-09-04 21:05:50,289::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:05:50,290::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-14::DEBUG::2014-09-04 21:05:50,297::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-14::DEBUG::2014-09-04 21:05:50,298::__init__::225::IOProcess::(_processLogs) Message size is 183 >Thread-14::DEBUG::2014-09-04 21:05:50,299::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:05:50,301::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-04 21:05:50,303::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:05:50,304::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:05:50,305::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:05:50,306::__init__::225::IOProcess::(_processLogs) (844254) Finding callback 'access'... >Thread-14::DEBUG::2014-09-04 21:05:50,308::__init__::225::IOProcess::(_processLogs) (844254) Got request for method 'access' >Thread-14::DEBUG::2014-09-04 21:05:50,309::__init__::225::IOProcess::(_processLogs) (844254) Building response >Thread-14::DEBUG::2014-09-04 21:05:50,310::__init__::225::IOProcess::(_processLogs) (844254) Queuing response >Thread-14::DEBUG::2014-09-04 21:05:50,313::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:05:50,314::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-14::DEBUG::2014-09-04 21:05:50,318::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-14::DEBUG::2014-09-04 21:05:50,319::__init__::225::IOProcess::(_processLogs) Message size is 187 >Thread-14::DEBUG::2014-09-04 21:05:50,320::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:05:50,322::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-04 21:05:50,323::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:05:50,324::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:05:50,325::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-14::DEBUG::2014-09-04 21:05:50,326::__init__::225::IOProcess::(_processLogs) (844255) Finding callback 'access'... >Thread-14::DEBUG::2014-09-04 21:05:50,327::__init__::225::IOProcess::(_processLogs) (844255) Got request for method 'access' >Thread-14::DEBUG::2014-09-04 21:05:50,329::__init__::225::IOProcess::(_processLogs) (844255) Building response >Thread-14::DEBUG::2014-09-04 21:05:50,330::__init__::225::IOProcess::(_processLogs) (844255) Queuing response >Thread-14::DEBUG::2014-09-04 21:05:50,331::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:05:50,332::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-14::DEBUG::2014-09-04 21:05:50,336::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-14::DEBUG::2014-09-04 21:05:50,338::__init__::225::IOProcess::(_processLogs) Message size is 189 >Thread-14::DEBUG::2014-09-04 21:05:50,339::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:05:50,340::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-04 21:05:50,341::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:05:50,342::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:05:50,343::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:05:50,345::__init__::225::IOProcess::(_processLogs) (844256) Finding callback 'access'... >Thread-14::DEBUG::2014-09-04 21:05:50,346::__init__::225::IOProcess::(_processLogs) (844256) Got request for method 'access' >Thread-14::DEBUG::2014-09-04 21:05:50,347::__init__::225::IOProcess::(_processLogs) (844256) Building response >Thread-14::DEBUG::2014-09-04 21:05:50,348::__init__::225::IOProcess::(_processLogs) (844256) Queuing response >Thread-14::DEBUG::2014-09-04 21:05:50,349::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:05:50,350::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-14054::DEBUG::2014-09-04 21:05:51,074::task::595::Storage.TaskManager.Task::(_updateState) Task=`04338786-4744-445a-92e5-f3abb60a444a`::moving from state init -> state preparing >Thread-14054::INFO::2014-09-04 21:05:51,075::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14054::INFO::2014-09-04 21:05:51,075::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180c43ee-5baf-41b7-87c7-c0214b51fe8f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000352138', 'lastCheck': '0.7', 'valid': True}, '7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000399333', 'lastCheck': '6.2', 'valid': True}, '7ad04229-b793-4f73-ad10-5e41a4e836ff': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000395798', 'lastCheck': '6.3', 'valid': True}} >Thread-14054::DEBUG::2014-09-04 21:05:51,075::task::1191::Storage.TaskManager.Task::(prepare) Task=`04338786-4744-445a-92e5-f3abb60a444a`::finished: {'180c43ee-5baf-41b7-87c7-c0214b51fe8f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000352138', 'lastCheck': '0.7', 'valid': True}, '7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000399333', 'lastCheck': '6.2', 'valid': True}, '7ad04229-b793-4f73-ad10-5e41a4e836ff': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000395798', 'lastCheck': '6.3', 'valid': True}} >Thread-14054::DEBUG::2014-09-04 21:05:51,075::task::595::Storage.TaskManager.Task::(_updateState) Task=`04338786-4744-445a-92e5-f3abb60a444a`::moving from state preparing -> state finished >Thread-14054::DEBUG::2014-09-04 21:05:51,075::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14054::DEBUG::2014-09-04 21:05:51,075::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14054::DEBUG::2014-09-04 21:05:51,076::task::993::Storage.TaskManager.Task::(_decref) Task=`04338786-4744-445a-92e5-f3abb60a444a`::ref 0 aborting False >Thread-14054::DEBUG::2014-09-04 21:05:51,097::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >Thread-14054::DEBUG::2014-09-04 21:05:51,097::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >Dummy-41::DEBUG::2014-09-04 21:05:51,840::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/78390355-2a2d-41e5-aea5-fb426559f747/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-41::DEBUG::2014-09-04 21:05:52,215::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0123418 s, 83.0 MB/s\n'; <rc> = 0 >Dummy-41::DEBUG::2014-09-04 21:05:54,227::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/78390355-2a2d-41e5-aea5-fb426559f747/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-9209::DEBUG::2014-09-04 21:05:54,549::task::595::Storage.TaskManager.Task::(_updateState) Task=`523df81e-312c-40cc-8dbc-8ca4cd71888a`::moving from state init -> state preparing >Thread-9209::INFO::2014-09-04 21:05:54,550::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='180c43ee-5baf-41b7-87c7-c0214b51fe8f', spUUID='78390355-2a2d-41e5-aea5-fb426559f747', imgUUID='70069763-69d2-42a9-86e7-23db8019e0b3', volUUID='0f679bfe-49c1-4e90-b02a-4f075a42fda5', options=None) >Thread-14::DEBUG::2014-09-04 21:05:54,551::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-14::DEBUG::2014-09-04 21:05:54,551::__init__::225::IOProcess::(_processLogs) Message size is 244 >Thread-14::DEBUG::2014-09-04 21:05:54,551::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:05:54,552::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-14::DEBUG::2014-09-04 21:05:54,552::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:05:54,552::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:05:54,552::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:05:54,552::__init__::225::IOProcess::(_processLogs) (844257) Finding callback 'stat'... >Thread-14::DEBUG::2014-09-04 21:05:54,553::__init__::225::IOProcess::(_processLogs) (844257) Got request for method 'stat' >Thread-14::DEBUG::2014-09-04 21:05:54,555::__init__::225::IOProcess::(_processLogs) DEBUG|(844257) Building response >Thread-14::DEBUG::2014-09-04 21:05:54,556::__init__::225::IOProcess::(_processLogs) (844257) Queuing response >Thread-14::DEBUG::2014-09-04 21:05:54,557::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:05:54,558::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 327 >Thread-14::DEBUG::2014-09-04 21:05:54,564::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-14::DEBUG::2014-09-04 21:05:54,564::__init__::225::IOProcess::(_processLogs) Message size is 244 >Thread-14::DEBUG::2014-09-04 21:05:54,565::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:05:54,566::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-04 21:05:54,567::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:05:54,568::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:05:54,569::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-14::DEBUG::2014-09-04 21:05:54,570::__init__::225::IOProcess::(_processLogs) (844258) Finding callback 'stat'... >Thread-14::DEBUG::2014-09-04 21:05:54,571::__init__::225::IOProcess::(_processLogs) (844258) Got request for method 'stat' >Thread-14::DEBUG::2014-09-04 21:05:54,572::__init__::225::IOProcess::(_processLogs) (844258) Building response >Thread-14::DEBUG::2014-09-04 21:05:54,573::__init__::225::IOProcess::(_processLogs) (844258) Queuing response >Thread-14::DEBUG::2014-09-04 21:05:54,574::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:05:54,574::__init__::225::IOProcess::(_processLogs) Sending response sized 327 >Thread-9209::INFO::2014-09-04 21:05:54,578::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '24576', 'apparentsize': '1073741824'} >Thread-9209::DEBUG::2014-09-04 21:05:54,579::task::1191::Storage.TaskManager.Task::(prepare) Task=`523df81e-312c-40cc-8dbc-8ca4cd71888a`::finished: {'truesize': '24576', 'apparentsize': '1073741824'} >Thread-9209::DEBUG::2014-09-04 21:05:54,579::task::595::Storage.TaskManager.Task::(_updateState) Task=`523df81e-312c-40cc-8dbc-8ca4cd71888a`::moving from state preparing -> state finished >Thread-9209::DEBUG::2014-09-04 21:05:54,580::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-9209::DEBUG::2014-09-04 21:05:54,615::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Dummy-41::DEBUG::2014-09-04 21:05:54,616::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0340476 s, 30.1 MB/s\n'; <rc> = 0 >Thread-9209::DEBUG::2014-09-04 21:05:54,616::task::993::Storage.TaskManager.Task::(_decref) Task=`523df81e-312c-40cc-8dbc-8ca4cd71888a`::ref 0 aborting False >Thread-14::DEBUG::2014-09-04 21:05:54,793::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >GuestMonitor-numa__test::DEBUG::2014-09-04 21:05:54,796::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >Thread-14::DEBUG::2014-09-04 21:05:54,796::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-14::DEBUG::2014-09-04 21:05:54,801::__init__::225::IOProcess::(_processLogs) Marshaling message... >GuestMonitor-quota__vm::DEBUG::2014-09-04 21:05:54,802::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >Thread-14::DEBUG::2014-09-04 21:05:54,805::__init__::225::IOProcess::(_processLogs) Queuing request... >GuestMonitor-numa__test::DEBUG::2014-09-04 21:05:54,806::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >Thread-14::DEBUG::2014-09-04 21:05:54,808::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:05:54,812::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >GuestMonitor-quota__vm::DEBUG::2014-09-04 21:05:54,815::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >Thread-14::DEBUG::2014-09-04 21:05:54,815::__init__::225::IOProcess::(_processLogs) Extracting request information... >GuestMonitor-numa__test::DEBUG::2014-09-04 21:05:54,816::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >Thread-14::DEBUG::2014-09-04 21:05:54,818::__init__::225::IOProcess::(_processLogs) (844259) Finding callback 'statvfs'... >Thread-14::DEBUG::2014-09-04 21:05:54,822::__init__::225::IOProcess::(_processLogs) (844259) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-04 21:05:54,824::__init__::225::IOProcess::(_processLogs) (844259) Building response >GuestMonitor-quota__vm::DEBUG::2014-09-04 21:05:54,825::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >Thread-14::DEBUG::2014-09-04 21:05:54,825::__init__::225::IOProcess::(_processLogs) (844259) Queuing response >Thread-14::DEBUG::2014-09-04 21:05:54,826::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:05:54,827::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-10379::DEBUG::2014-09-04 21:05:54,829::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_mavital/7ad04229-b793-4f73-ad10-5e41a4e836ff/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-14::DEBUG::2014-09-04 21:05:55,153::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-14054::DEBUG::2014-09-04 21:05:55,315::BindingXMLRPC::318::vds::(wrapper) client [10.35.163.104] >Thread-10379::DEBUG::2014-09-04 21:05:55,315::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n339 bytes (339 B) copied, 0.000308841 s, 1.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-04 21:05:55,322::__init__::225::IOProcess::(_processLogs) Message size is 190 >Thread-14054::DEBUG::2014-09-04 21:05:55,327::task::595::Storage.TaskManager.Task::(_updateState) Task=`f4ccd2d9-e8e9-44b8-b21e-fc25835e073d`::moving from state init -> state preparing >Thread-14::DEBUG::2014-09-04 21:05:55,328::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14054::INFO::2014-09-04 21:05:55,329::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='78390355-2a2d-41e5-aea5-fb426559f747', options=None) >Thread-14::DEBUG::2014-09-04 21:05:55,329::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-04 21:05:55,330::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:05:55,330::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:05:55,331::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:05:55,331::__init__::225::IOProcess::(_processLogs) (844260) Finding callback 'statvfs'... >Thread-14::DEBUG::2014-09-04 21:05:55,331::__init__::225::IOProcess::(_processLogs) (844260) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-04 21:05:55,331::__init__::225::IOProcess::(_processLogs) DEBUG|(844260) Building response >Thread-14::DEBUG::2014-09-04 21:05:55,331::__init__::225::IOProcess::(_processLogs) (844260) Queuing response >Thread-14::DEBUG::2014-09-04 21:05:55,332::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:05:55,332::__init__::225::IOProcess::(_processLogs) Sending response sized 329 >Thread-14::DEBUG::2014-09-04 21:05:55,335::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-18::DEBUG::2014-09-04 21:05:55,336::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_qa_shared__iso__domain/7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-14::DEBUG::2014-09-04 21:05:55,336::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-14054::INFO::2014-09-04 21:05:55,845::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 8L}} >Thread-14::DEBUG::2014-09-04 21:05:55,850::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14054::DEBUG::2014-09-04 21:05:55,853::task::1191::Storage.TaskManager.Task::(prepare) Task=`f4ccd2d9-e8e9-44b8-b21e-fc25835e073d`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 8L}} >Thread-18::DEBUG::2014-09-04 21:05:55,853::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1581 bytes (1.6 kB) copied, 0.000535435 s, 3.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-04 21:05:55,854::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14054::DEBUG::2014-09-04 21:05:55,856::task::595::Storage.TaskManager.Task::(_updateState) Task=`f4ccd2d9-e8e9-44b8-b21e-fc25835e073d`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-09-04 21:05:55,860::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14054::DEBUG::2014-09-04 21:05:55,860::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-09-04 21:05:55,862::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14054::DEBUG::2014-09-04 21:05:55,862::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-09-04 21:05:55,864::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14054::DEBUG::2014-09-04 21:05:55,865::task::993::Storage.TaskManager.Task::(_decref) Task=`f4ccd2d9-e8e9-44b8-b21e-fc25835e073d`::ref 0 aborting False >Thread-14::DEBUG::2014-09-04 21:05:55,867::__init__::225::IOProcess::(_processLogs) (844261) Finding callback 'statvfs'... >Thread-14::DEBUG::2014-09-04 21:05:55,870::__init__::225::IOProcess::(_processLogs) (844261) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-04 21:05:55,873::__init__::225::IOProcess::(_processLogs) DEBUG|(844261) Building response >Thread-14::DEBUG::2014-09-04 21:05:55,874::__init__::225::IOProcess::(_processLogs) (844261) Queuing response >Thread-14::DEBUG::2014-09-04 21:05:55,875::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:05:55,876::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-14::DEBUG::2014-09-04 21:05:55,883::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-14::DEBUG::2014-09-04 21:05:55,885::__init__::225::IOProcess::(_processLogs) Message size is 190 >Thread-14::DEBUG::2014-09-04 21:05:55,890::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-43::DEBUG::2014-09-04 21:05:55,891::BindingXMLRPC::318::vds::(wrapper) client [10.35.163.104] >Thread-14::DEBUG::2014-09-04 21:05:55,895::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-43::DEBUG::2014-09-04 21:05:55,897::task::595::Storage.TaskManager.Task::(_updateState) Task=`52d647ba-c512-4891-94ed-effae81f3608`::moving from state init -> state preparing >Thread-14::DEBUG::2014-09-04 21:05:55,898::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-43::INFO::2014-09-04 21:05:55,899::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='78390355-2a2d-41e5-aea5-fb426559f747', options=None) >Thread-14::DEBUG::2014-09-04 21:05:55,902::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:05:55,905::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-43::DEBUG::2014-09-04 21:05:55,905::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.78390355-2a2d-41e5-aea5-fb426559f747`ReqID=`d06f3e9c-b04c-4908-b52b-b48806d663c7`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-43::DEBUG::2014-09-04 21:05:55,907::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.78390355-2a2d-41e5-aea5-fb426559f747' for lock type 'shared' >Thread-14::DEBUG::2014-09-04 21:05:55,908::__init__::225::IOProcess::(_processLogs) (844262) Finding callback 'statvfs'... >Thread-43::DEBUG::2014-09-04 21:05:55,911::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.78390355-2a2d-41e5-aea5-fb426559f747' is free. Now locking as 'shared' (1 active user) >Thread-14::DEBUG::2014-09-04 21:05:55,911::__init__::225::IOProcess::(_processLogs) (844262) Got request for method 'statvfs' >Thread-43::DEBUG::2014-09-04 21:05:55,913::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.78390355-2a2d-41e5-aea5-fb426559f747`ReqID=`d06f3e9c-b04c-4908-b52b-b48806d663c7`::Granted request >Thread-14::DEBUG::2014-09-04 21:05:55,914::__init__::225::IOProcess::(_processLogs) DEBUG|(844262) Building response >Thread-14::DEBUG::2014-09-04 21:05:55,917::__init__::225::IOProcess::(_processLogs) (844262) Queuing response >Thread-43::DEBUG::2014-09-04 21:05:55,919::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`52d647ba-c512-4891-94ed-effae81f3608`::_resourcesAcquired: Storage.78390355-2a2d-41e5-aea5-fb426559f747 (shared) >Thread-14::DEBUG::2014-09-04 21:05:55,920::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-43::DEBUG::2014-09-04 21:05:55,921::task::993::Storage.TaskManager.Task::(_decref) Task=`52d647ba-c512-4891-94ed-effae81f3608`::ref 1 aborting False >Thread-14::DEBUG::2014-09-04 21:05:55,923::__init__::225::IOProcess::(_processLogs) Sending response sized 329 >Thread-43::INFO::2014-09-04 21:05:55,965::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': u'/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_qa_shared__iso__domain/7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 8L, 'domains': '180c43ee-5baf-41b7-87c7-c0214b51fe8f:Active,7ad04229-b793-4f73-ad10-5e41a4e836ff:Active,7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6:Active', 'master_uuid': u'180c43ee-5baf-41b7-87c7-c0214b51fe8f', 'version': '3', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'180c43ee-5baf-41b7-87c7-c0214b51fe8f': {'status': 'Active', 'diskfree': '1820607315968', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246104576', 'version': 3}, '7ad04229-b793-4f73-ad10-5e41a4e836ff': {'status': 'Active', 'diskfree': '1820607315968', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246104576', 'version': 0}, '7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6': {'status': 'Active', 'diskfree': '18882756608', 'isoprefix': u'/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_qa_shared__iso__domain/7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '652611682304', 'version': 0}}} >Thread-43::DEBUG::2014-09-04 21:05:55,966::task::1191::Storage.TaskManager.Task::(prepare) Task=`52d647ba-c512-4891-94ed-effae81f3608`::finished: {'info': {'name': 'No Description', 'isoprefix': u'/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_qa_shared__iso__domain/7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 8L, 'domains': '180c43ee-5baf-41b7-87c7-c0214b51fe8f:Active,7ad04229-b793-4f73-ad10-5e41a4e836ff:Active,7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6:Active', 'master_uuid': u'180c43ee-5baf-41b7-87c7-c0214b51fe8f', 'version': '3', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'180c43ee-5baf-41b7-87c7-c0214b51fe8f': {'status': 'Active', 'diskfree': '1820607315968', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246104576', 'version': 3}, '7ad04229-b793-4f73-ad10-5e41a4e836ff': {'status': 'Active', 'diskfree': '1820607315968', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246104576', 'version': 0}, '7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6': {'status': 'Active', 'diskfree': '18882756608', 'isoprefix': u'/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_qa_shared__iso__domain/7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '652611682304', 'version': 0}}} >Thread-43::DEBUG::2014-09-04 21:05:55,967::task::595::Storage.TaskManager.Task::(_updateState) Task=`52d647ba-c512-4891-94ed-effae81f3608`::moving from state preparing -> state finished >Thread-43::DEBUG::2014-09-04 21:05:55,968::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.78390355-2a2d-41e5-aea5-fb426559f747': < ResourceRef 'Storage.78390355-2a2d-41e5-aea5-fb426559f747', isValid: 'True' obj: 'None'>} >Thread-43::DEBUG::2014-09-04 21:05:55,969::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-43::DEBUG::2014-09-04 21:05:55,971::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.78390355-2a2d-41e5-aea5-fb426559f747' >Thread-43::DEBUG::2014-09-04 21:05:55,972::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.78390355-2a2d-41e5-aea5-fb426559f747' (0 active users) >Thread-43::DEBUG::2014-09-04 21:05:55,973::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.78390355-2a2d-41e5-aea5-fb426559f747' is free, finding out if anyone is waiting for it. >Thread-43::DEBUG::2014-09-04 21:05:55,974::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.78390355-2a2d-41e5-aea5-fb426559f747', Clearing records. >Thread-43::DEBUG::2014-09-04 21:05:55,975::task::993::Storage.TaskManager.Task::(_decref) Task=`52d647ba-c512-4891-94ed-effae81f3608`::ref 0 aborting False >Dummy-41::DEBUG::2014-09-04 21:05:56,630::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/78390355-2a2d-41e5-aea5-fb426559f747/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-41::DEBUG::2014-09-04 21:05:56,996::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0155333 s, 65.9 MB/s\n'; <rc> = 0 >Dummy-41::DEBUG::2014-09-04 21:05:59,005::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/78390355-2a2d-41e5-aea5-fb426559f747/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-41::DEBUG::2014-09-04 21:05:59,367::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0127182 s, 80.5 MB/s\n'; <rc> = 0 >GuestMonitor-numa__test::DEBUG::2014-09-04 21:05:59,829::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >GuestMonitor-numa__test::DEBUG::2014-09-04 21:05:59,830::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >GuestMonitor-numa__test::DEBUG::2014-09-04 21:05:59,830::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`7e7c2056-74d0-430b-828f-f1e101ad1185`::Domain Metadata is not set >GuestMonitor-quota__vm::DEBUG::2014-09-04 21:05:59,834::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >GuestMonitor-quota__vm::DEBUG::2014-09-04 21:05:59,834::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >GuestMonitor-quota__vm::DEBUG::2014-09-04 21:05:59,835::vm::481::vm.Vm::(_getUserCpuTuneInfo) vmId=`3668b74e-aa90-4bf0-87d6-d8f38e903d9c`::Domain Metadata is not set >Thread-14::DEBUG::2014-09-04 21:06:00,362::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-14::DEBUG::2014-09-04 21:06:00,362::__init__::225::IOProcess::(_processLogs) Message size is 166 >Thread-14::DEBUG::2014-09-04 21:06:00,362::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:06:00,362::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-04 21:06:00,363::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:06:00,363::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:06:00,363::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:06:00,363::__init__::225::IOProcess::(_processLogs) (844263) Finding callback 'statvfs'... >Thread-14::DEBUG::2014-09-04 21:06:00,363::__init__::225::IOProcess::(_processLogs) (844263) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-04 21:06:00,363::__init__::225::IOProcess::(_processLogs) DEBUG|(844263) Building response >Thread-14::DEBUG::2014-09-04 21:06:00,363::__init__::225::IOProcess::(_processLogs) (844263) Queuing response >Thread-14::DEBUG::2014-09-04 21:06:00,363::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:06:00,364::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-17::DEBUG::2014-09-04 21:06:00,364::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_artyom__storage__rhevm__35/180c43ee-5baf-41b7-87c7-c0214b51fe8f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-09-04 21:06:00,695::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n474 bytes (474 B) copied, 0.000307661 s, 1.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-09-04 21:06:00,698::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-14::DEBUG::2014-09-04 21:06:00,700::__init__::225::IOProcess::(_processLogs) Message size is 166 >Thread-14::DEBUG::2014-09-04 21:06:00,701::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:06:00,702::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-04 21:06:00,703::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:06:00,704::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:06:00,705::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:06:00,707::__init__::225::IOProcess::(_processLogs) (844264) Finding callback 'statvfs'... >Thread-14::DEBUG::2014-09-04 21:06:00,708::__init__::225::IOProcess::(_processLogs) (844264) Got request for method 'statvfs' >Thread-14::DEBUG::2014-09-04 21:06:00,709::__init__::225::IOProcess::(_processLogs) (844264) Building response >Thread-14::DEBUG::2014-09-04 21:06:00,710::__init__::225::IOProcess::(_processLogs) (844264) Queuing response >Thread-14::DEBUG::2014-09-04 21:06:00,711::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:06:00,712::__init__::225::IOProcess::(_processLogs) Sending response sized 336 >Thread-14::DEBUG::2014-09-04 21:06:00,719::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-14::DEBUG::2014-09-04 21:06:00,720::__init__::225::IOProcess::(_processLogs) Message size is 183 >Thread-14::DEBUG::2014-09-04 21:06:00,721::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:06:00,723::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-04 21:06:00,724::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:06:00,725::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:06:00,726::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-14::DEBUG::2014-09-04 21:06:00,727::__init__::225::IOProcess::(_processLogs) (844265) Finding callback 'access'... >Thread-14::DEBUG::2014-09-04 21:06:00,728::__init__::225::IOProcess::(_processLogs) (844265) Got request for method 'access' >Thread-14::DEBUG::2014-09-04 21:06:00,729::__init__::225::IOProcess::(_processLogs) (844265) Building response >Thread-14::DEBUG::2014-09-04 21:06:00,730::__init__::225::IOProcess::(_processLogs) (844265) Queuing response >Thread-14::DEBUG::2014-09-04 21:06:00,731::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:06:00,732::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-14::DEBUG::2014-09-04 21:06:00,736::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-14::DEBUG::2014-09-04 21:06:00,737::__init__::225::IOProcess::(_processLogs) Message size is 187 >Thread-14::DEBUG::2014-09-04 21:06:00,738::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:06:00,739::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-04 21:06:00,741::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:06:00,742::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:06:00,743::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:06:00,744::__init__::225::IOProcess::(_processLogs) (844266) Finding callback 'access'... >Thread-14::DEBUG::2014-09-04 21:06:00,745::__init__::225::IOProcess::(_processLogs) (844266) Got request for method 'access' >Thread-14::DEBUG::2014-09-04 21:06:00,746::__init__::225::IOProcess::(_processLogs) (844266) Building response >Thread-14::DEBUG::2014-09-04 21:06:00,749::__init__::225::IOProcess::(_processLogs) (844266) Queuing response >Thread-14::DEBUG::2014-09-04 21:06:00,750::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:06:00,751::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Thread-14::DEBUG::2014-09-04 21:06:00,755::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-14::DEBUG::2014-09-04 21:06:00,756::__init__::225::IOProcess::(_processLogs) Message size is 189 >Thread-14::DEBUG::2014-09-04 21:06:00,757::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-14::DEBUG::2014-09-04 21:06:00,758::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-14::DEBUG::2014-09-04 21:06:00,759::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-09-04 21:06:00,760::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-09-04 21:06:00,761::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::DEBUG::2014-09-04 21:06:00,762::__init__::225::IOProcess::(_processLogs) (844267) Finding callback 'access'... >Thread-14::DEBUG::2014-09-04 21:06:00,763::__init__::225::IOProcess::(_processLogs) (844267) Got request for method 'access' >Thread-14::DEBUG::2014-09-04 21:06:00,764::__init__::225::IOProcess::(_processLogs) DEBUG|(844267) Building response >Thread-14::DEBUG::2014-09-04 21:06:00,766::__init__::225::IOProcess::(_processLogs) (844267) Queuing response >Thread-14::DEBUG::2014-09-04 21:06:00,767::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::DEBUG::2014-09-04 21:06:00,768::__init__::225::IOProcess::(_processLogs) Sending response sized 76 >Dummy-41::DEBUG::2014-09-04 21:06:01,541::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/78390355-2a2d-41e5-aea5-fb426559f747/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-41::DEBUG::2014-09-04 21:06:02,283::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0134598 s, 76.1 MB/s\n'; <rc> = 0
You cannot view the attachment while viewing its details because your browser does not support IFRAMEs.
View the attachment on a separate page
.
View Attachment As Raw
Actions:
View
Attachments on
bug 1138419
: 934589 |
934591